-- Logs begin at Mon 2022-06-20 17:58:17 UTC, end at Mon 2022-06-20 19:13:44 UTC. -- Jun 20 18:32:14.169792 dv-cinder-836973-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 18:32:14.177475 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 18:32:14 2022] *** Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: nodename: dv-cinder-836973-6-iscsi Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: machine: x86_64 Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: clock source: unix Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: pcre jit disabled Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: detected number of CPU cores: 4 Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: current working directory: / Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: detected binary path: /usr/bin/uwsgi-core Jun 20 18:32:14.180557 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: your processes number limit is 47680 Jun 20 18:32:14.181245 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: your memory page size is 4096 bytes Jun 20 18:32:14.181245 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: detected max file descriptor number: 2048 Jun 20 18:32:14.181245 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: lock engine: pthread robust mutexes Jun 20 18:32:14.181245 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: thunder lock: enabled Jun 20 18:32:14.181245 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 18:32:14.181245 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 18:32:14.223325 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: Python main interpreter initialized at 0x5636765519c0 Jun 20 18:32:14.223325 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: python threads support enabled Jun 20 18:32:14.223325 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: your server socket listen backlog is limited to 100 connections Jun 20 18:32:14.223325 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: your mercy for graceful operations on workers is 90 seconds Jun 20 18:32:14.223650 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 18:32:14.223724 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: *** Operational MODE: preforking *** Jun 20 18:32:14.223993 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: *** uWSGI is running in multiple interpreter mode *** Jun 20 18:32:14.223993 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: spawned uWSGI master process (pid: 86906) Jun 20 18:32:14.224183 dv-cinder-836973-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 20 18:32:14.225324 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: spawned uWSGI worker 1 (pid: 86913, cores: 1) Jun 20 18:32:14.227040 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: spawned uWSGI worker 2 (pid: 86914, cores: 1) Jun 20 18:32:14.227040 dv-cinder-836973-6-iscsi devstack@keystone.service[86906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 18:32:19.663685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:32:19.663685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: from cryptography.utils import int_from_bytes Jun 20 18:32:19.664492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:32:19.664492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: from cryptography.utils import int_from_bytes Jun 20 18:32:19.664906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:32:19.664906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: from cryptography.utils import int_from_bytes Jun 20 18:32:19.665016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 18:32:19.665016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: from cryptography.utils import int_from_bytes Jun 20 18:32:19.713063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 18:32:19.713337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 18:32:19.713422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 18:32:19.713502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] command line args: [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 18:32:19.713569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 18:32:19.713729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 18:32:19.713821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] command line args: [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 18:32:19.713884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ================================================================================ {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 18:32:19.714025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 18:32:19.714112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] admin_token = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.714179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ================================================================================ {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 18:32:19.714351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] config_dir = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.714444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] admin_token = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.714598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.715241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] config_dir = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.715316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] config_source = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.715382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.715451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] debug = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.715511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] config_source = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.715569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] debug = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] list_limit = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] log_config_append = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] list_limit = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] log_config_append = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.717955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] log_dir = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] log_file = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] log_dir = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] log_file = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.718993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719266 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.719843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720778 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.720967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] publish_errors = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] publish_errors = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.721955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] standard_threads = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] standard_threads = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.722905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] use_journal = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] use_json = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] use_journal = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] use_stderr = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] use_json = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] use_syslog = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] use_stderr = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] use_syslog = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.723957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 18:32:19.724041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.724213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.724291 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.724451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.724535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.725240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.725332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.725488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.725568 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.725727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.725805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.725964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.726951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.727962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.728925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.729889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.730839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.731947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.732954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.733956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.734975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.735994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.736871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.737953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.738883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739465 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739849 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.739924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.740922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.741889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.742994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.743932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.744961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.745906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746138 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.746978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.747924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.748974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] auth.external = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] auth.external = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.749957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] auth.password = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] auth.password = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] auth.token = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750560 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] auth.token = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.750873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.751857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] credential.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] credential.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.752970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.753983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.754169 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.754256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.754402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.754481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.754645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.754723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.754897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.755951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.756925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.757946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.758894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.759865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.760949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761732 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.761966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.762946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.763930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.764844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.765940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.766890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.767902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.768994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.769920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.770962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.771118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.771196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.771354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.771915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.772901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.773988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.774947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.775981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.776914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.777859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.778988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.779933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.780012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.780163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.780249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.780400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.780481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.780910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.780997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.781960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.782877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] role.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] role.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] role.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] role.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.783842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.784978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.785929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.786897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.787085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.787869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.787959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.788941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.789901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.790820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.791980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.792922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.793965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.794909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.795877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.connection = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.796894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.connection = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.797999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.798951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.799969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.800997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 18:32:19.801077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 18:32:19.801216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 18:32:19.830942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.831189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.831359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.831444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.831600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.831830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.840358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.840792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.868362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.868593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.868826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:19.869062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.010274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.011493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.059119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.059353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.059788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.060026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.122596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.122823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.123957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.124188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.148939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.149167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.149345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.149494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.149667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.149799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.149927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.150070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.150202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.150333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.150464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.150595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.150724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.150724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.161378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.161707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.174998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.175130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.175213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.175339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.175423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.175551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 18:32:20.192402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.192610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 18:32:20.192943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.193027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.193146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 18:32:20.193231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 18:32:20.193936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.194045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.194195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.194275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 18:32:20.194447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.194530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.194699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.194779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.195026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.195285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.205503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.205769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.206032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.206115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.206308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.206405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.206630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.206929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.215217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.215805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.218504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.218781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.219085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.219170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.219369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.219463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.219647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.219729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.219900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.219982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.220163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.220247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.220428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.220510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.220693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.220774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.220962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.221042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.221221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.221301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.221488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.221753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.247660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.248287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.249274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.249549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.249897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.250178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.254788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.255205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.255478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.255562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.256383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.256666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.263337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.263573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.263968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.264252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.268053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.268338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.268615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.268758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.268898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.269972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.270141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.270409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.270671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.289595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.289864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.290227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.290503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.294625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.295299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.298266 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.298653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.298952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.299371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.303744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.304439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.307352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.308099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.311007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.311303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.311584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.311781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.311864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.312078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.312173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.312362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.312672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.312766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.312910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.313188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.331985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.332273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.332539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.332804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.332898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.333136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.333402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.333675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.341229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.342146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.342940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.343218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.343872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.344148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.346404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.346697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.347015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.347376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.347460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.347650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.347742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.347929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.348218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.348496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.360955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.361230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.361512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.361789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.362774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.363083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.363302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.363387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.363598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.363682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.363895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.365157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.365469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.365761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.382235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.384175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.385546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.387502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.388873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.390598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.390783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.392245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.392523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.392606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.392802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.394160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.394437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.394716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.400703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.402310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.402571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.404202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.405540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.406095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.406481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.406756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.407737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.408025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.408408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.408682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.415872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.416151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.416425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.417805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.418089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.418366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.424294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.424571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.424849 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.425120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.425387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.425761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.426043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.426282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 18:32:20.426374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.426558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.426649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.426836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.426949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.427129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.427212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.427401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.427490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.427696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.427779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.427965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.428046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.428332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.428602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.428869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.429138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.429417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.429683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.429949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 18:32:20.466455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636765519c0 pid: 86913 (default app) Jun 20 18:32:20.468845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636765519c0 pid: 86914 (default app) Jun 20 18:32:20.469819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce79e5-fba2-4686-9ac0-ec85000440d5 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:20.470128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce79e5-fba2-4686-9ac0-ec85000440d5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:20.470412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce79e5-fba2-4686-9ac0-ec85000440d5 None None] PATH_INFO: `/v3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:20.474594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Mon Jun 20 18:32:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:28.174799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287888e-2a45-4a43-ab48-730d84a891e0 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:28.175404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287888e-2a45-4a43-ab48-730d84a891e0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:28.175404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287888e-2a45-4a43-ab48-730d84a891e0 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:28.180240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:28.186232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:28.186635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:28.186805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:28.257315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: INFO dbcounter [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] Registered counter for database keystone Jun 20 18:32:28.278511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG oslo_db.sqlalchemy.engines [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:32:28.284970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writer thread running {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:32:28.466214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG passlib.handlers.bcrypt [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86913) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 18:32:28.466551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG passlib.handlers.bcrypt [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86913) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 18:32:28.520285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:28.522476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:28.648649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 20 18:32:28.792094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287888e-2a45-4a43-ab48-730d84a891e0 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:28.863019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: INFO dbcounter [None req-b287888e-2a45-4a43-ab48-730d84a891e0 None None] Registered counter for database keystone Jun 20 18:32:28.883147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG oslo_db.sqlalchemy.engines [None req-b287888e-2a45-4a43-ab48-730d84a891e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 18:32:28.889230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writer thread running {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 18:32:29.015848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287888e-2a45-4a43-ab48-730d84a891e0 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:29.020134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf5cb-df67-4f32-933f-7c288dbe4942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:29.020804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf5cb-df67-4f32-933f-7c288dbe4942 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:29.021095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf5cb-df67-4f32-933f-7c288dbe4942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:29.021408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf5cb-df67-4f32-933f-7c288dbe4942 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:29.029546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf5cb-df67-4f32-933f-7c288dbe4942 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:29.080893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9f8bf5cb-df67-4f32-933f-7c288dbe4942 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 18:32:29.081191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf5cb-df67-4f32-933f-7c288dbe4942 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:29.090669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Mon Jun 20 18:32:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:32:29.096592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:29.111502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925f754-0a84-4ef4-bf2f-f52005fd5f44 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:29.116527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177be665-c003-4d39-bb08-83d65f3c0646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:29.117651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be665-c003-4d39-bb08-83d65f3c0646 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:29.117948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be665-c003-4d39-bb08-83d65f3c0646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:29.118233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177be665-c003-4d39-bb08-83d65f3c0646 admin admin] PATH_INFO: `/v3/projects/a0b525758c904932afef5b70ff9bce58` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:29.122303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177be665-c003-4d39-bb08-83d65f3c0646 admin admin] RBAC: Authorizing `identity:get_project(project_id=a0b525758c904932afef5b70ff9bce58)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:29.171955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING keystone.common.rbac_enforcer.enforcer [None req-177be665-c003-4d39-bb08-83d65f3c0646 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 18:32:29.172310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177be665-c003-4d39-bb08-83d65f3c0646 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:29.176860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Mon Jun 20 18:32:29 2022] GET /identity/v3/projects/a0b525758c904932afef5b70ff9bce58 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:31.167447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f491c-362e-40bc-ab46-2523d44ab24c None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:31.167960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f491c-362e-40bc-ab46-2523d44ab24c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:31.168057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f491c-362e-40bc-ab46-2523d44ab24c None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:31.172156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:31.177423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b44e-965d-403c-bb5c-b60f210e606b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:31.178281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b44e-965d-403c-bb5c-b60f210e606b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:31.178474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b44e-965d-403c-bb5c-b60f210e606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:31.197371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-08a2b44e-965d-403c-bb5c-b60f210e606b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:31.198879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-08a2b44e-965d-403c-bb5c-b60f210e606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:31.206541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 18:32:31.228255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f491c-362e-40bc-ab46-2523d44ab24c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:31.240701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f491c-362e-40bc-ab46-2523d44ab24c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:31.244932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d7a1f-d985-490a-a6db-b4e757d87edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:31.245566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7a1f-d985-490a-a6db-b4e757d87edf admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:31.245861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7a1f-d985-490a-a6db-b4e757d87edf admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:31.246147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7a1f-d985-490a-a6db-b4e757d87edf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:31.253839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d7a1f-d985-490a-a6db-b4e757d87edf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:31.255738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d7a1f-d985-490a-a6db-b4e757d87edf admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:31.264467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Mon Jun 20 18:32:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:32:31.269598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b44e-965d-403c-bb5c-b60f210e606b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:31.278851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b44e-965d-403c-bb5c-b60f210e606b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:31.283407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4edf12-fd71-4687-a96d-26f709963a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:31.284261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4edf12-fd71-4687-a96d-26f709963a8d admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:31.284550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4edf12-fd71-4687-a96d-26f709963a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:31.284828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4edf12-fd71-4687-a96d-26f709963a8d admin admin] PATH_INFO: `/v3/users/f899d83db9084c5aa9d23df884d32076` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:31.286189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4edf12-fd71-4687-a96d-26f709963a8d admin admin] RBAC: Authorizing `identity:get_user(user_id=f899d83db9084c5aa9d23df884d32076)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:31.288109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4edf12-fd71-4687-a96d-26f709963a8d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:31.289639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Mon Jun 20 18:32:31 2022] GET /identity/v3/users/f899d83db9084c5aa9d23df884d32076 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:33.352143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc978-40d5-4320-ba40-8706b7bb357e None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.352669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc978-40d5-4320-ba40-8706b7bb357e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.352774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc978-40d5-4320-ba40-8706b7bb357e None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.354082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:33.359210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820519-949d-4eae-8172-847778705d18 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.359599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820519-949d-4eae-8172-847778705d18 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.359892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820519-949d-4eae-8172-847778705d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.369322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e40ef-4da1-4970-b18c-42de4260df84 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.369622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e40ef-4da1-4970-b18c-42de4260df84 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.369909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e40ef-4da1-4970-b18c-42de4260df84 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.371244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:32:33.375997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.376300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.376591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.376794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e9820519-949d-4eae-8172-847778705d18 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:33.377970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e9820519-949d-4eae-8172-847778705d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:33.416060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG passlib.handlers.bcrypt [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86914) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 18:32:33.416491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG passlib.handlers.bcrypt [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86914) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 18:32:33.457923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:32:33.462259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:33.463881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:33.480366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9820519-949d-4eae-8172-847778705d18 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:33.504370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:33.563865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:32:33.583969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9820519-949d-4eae-8172-847778705d18 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:33.586383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:33.618264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:33.619038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.619330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.619612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.630511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:33.641764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:33.642743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:33.643587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:32:33.648964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:33.686714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df709d-c52d-48f6-9626-fcb033723a85 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:33.689074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:33.725792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:33.726697 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.727020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.727305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.736073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:33.755168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e53ec-ebca-46c1-9fe2-7e66855b38fe None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:33.788969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:33.789644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.789937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.790228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.791021 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:33.791342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:33.792743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:33.793384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:33.794897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:33.804778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:33.810196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:33.891978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 18:32:33.898033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:33.900706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:33.910053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afea2-7ec8-454e-94cf-214996f4a22e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:33.943588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:33.944476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:33.944763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:33.945044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] PATH_INFO: `/v3/users/f899d83db9084c5aa9d23df884d32076` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:33.946252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] RBAC: Authorizing `identity:get_user(user_id=f899d83db9084c5aa9d23df884d32076)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:33.947753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:33.949386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:33 2022] GET /identity/v3/users/f899d83db9084c5aa9d23df884d32076 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:33.954714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:33.969526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:33.996639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6ac3-9d4e-4001-a91b-3ab06ef9a7d2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:34.030234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:34.031326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:34.031615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:34.031893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:34.051448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:34.053750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:34.061049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49df22d-f315-4cd6-8482-09cdaa7696dc None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:32:34.074531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:34.075539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:34.076670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:32:34.076670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:32:34.076670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:32:34.076670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:34.076670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:32:34.081511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:34.100468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:34.101282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:34.101577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:34.101864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:34.103096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:34.104560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:34.106172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:34.111683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:34.138053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:34.182317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad322f-a3af-44a8-a182-7939dbed7b99 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:34.191146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:34.211239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198c25b-6c3a-4195-98fb-1da2b1de1a4b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:34.216268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567e810-2016-4ee1-b6d3-ae4f2146ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:34.217016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e810-2016-4ee1-b6d3-ae4f2146ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:34.217363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e810-2016-4ee1-b6d3-ae4f2146ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:34.217661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e810-2016-4ee1-b6d3-ae4f2146ecc0 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:34.218411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567e810-2016-4ee1-b6d3-ae4f2146ecc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:34.218722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567e810-2016-4ee1-b6d3-ae4f2146ecc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:34.220181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567e810-2016-4ee1-b6d3-ae4f2146ecc0 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:34.256269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:34.256477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07985-2417-4547-b5d3-c3e80e8323e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:34.256477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07985-2417-4547-b5d3-c3e80e8323e1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:34.256477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07985-2417-4547-b5d3-c3e80e8323e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:34.256477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07985-2417-4547-b5d3-c3e80e8323e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:34.256836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07985-2417-4547-b5d3-c3e80e8323e1 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.domain.id=default, user.id=f899d83db9084c5aa9d23df884d32076) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:34.256836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07985-2417-4547-b5d3-c3e80e8323e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:34.256836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07985-2417-4547-b5d3-c3e80e8323e1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:34.263575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 11/21] 10.222.0.43 () {56 vars in 1322 bytes} [Mon Jun 20 18:32:34 2022] GET /identity/v3/role_assignments?user.id=f899d83db9084c5aa9d23df884d32076&scope.domain.id=default&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:36.735918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e8fe-b7ec-4b3c-a820-bb8697efafda None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:36.736416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e8fe-b7ec-4b3c-a820-bb8697efafda None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:36.736518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e8fe-b7ec-4b3c-a820-bb8697efafda None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:36.737873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 11/22] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:36.760980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470efc6-73c5-4b95-a4b7-e74da853b3dd None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:36.761899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470efc6-73c5-4b95-a4b7-e74da853b3dd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:36.762377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470efc6-73c5-4b95-a4b7-e74da853b3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:36.776033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c39d56-93bb-4885-9059-d173f58e2f1d None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:36.776648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c39d56-93bb-4885-9059-d173f58e2f1d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:36.777159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c39d56-93bb-4885-9059-d173f58e2f1d None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:36.779977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 12/23] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:36.784798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986290f-8090-4086-84a2-4bf81b922008 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:36.785340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986290f-8090-4086-84a2-4bf81b922008 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:36.785829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986290f-8090-4086-84a2-4bf81b922008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:36.790244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8470efc6-73c5-4b95-a4b7-e74da853b3dd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:36.790244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8470efc6-73c5-4b95-a4b7-e74da853b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:36.816361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6986290f-8090-4086-84a2-4bf81b922008 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:36.818804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6986290f-8090-4086-84a2-4bf81b922008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:36.941565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 12/24] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:36.942684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1079-3853-4242-abe1-a725a7c351f1 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:36.943519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1079-3853-4242-abe1-a725a7c351f1 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:36.943818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1079-3853-4242-abe1-a725a7c351f1 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:36.945246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 13/25] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:36.952932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5c2eb-ab6f-4fa5-bd5b-94abb2ca499a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:36.953228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5c2eb-ab6f-4fa5-bd5b-94abb2ca499a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:36.953514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5c2eb-ab6f-4fa5-bd5b-94abb2ca499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:36.965505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 13/26] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:36.986197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-72c5c2eb-ab6f-4fa5-bd5b-94abb2ca499a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:36.988022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986290f-8090-4086-84a2-4bf81b922008 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:36.992141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-72c5c2eb-ab6f-4fa5-bd5b-94abb2ca499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:37.063124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:37.123403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:37.123997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5c2eb-ab6f-4fa5-bd5b-94abb2ca499a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:37.135212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:37.150741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986290f-8090-4086-84a2-4bf81b922008 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:37.187729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d37da-922d-4621-b5a2-70fe622ec727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:37.188772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d37da-922d-4621-b5a2-70fe622ec727 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.189222 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d37da-922d-4621-b5a2-70fe622ec727 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.189640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d37da-922d-4621-b5a2-70fe622ec727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.201255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d37da-922d-4621-b5a2-70fe622ec727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:37.202990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d37da-922d-4621-b5a2-70fe622ec727 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-898d37da-922d-4621-b5a2-70fe622ec727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:32:37.227597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:37.228427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:37.229215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:32:37.229215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:32:37.229215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:32:37.229215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:37.229215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 14/28] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:32:37.230047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f2b4a-83ee-4a4f-a7fb-e4c39f11b708 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.230338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f2b4a-83ee-4a4f-a7fb-e4c39f11b708 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.230625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f2b4a-83ee-4a4f-a7fb-e4c39f11b708 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.232200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 15/29] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:37.232919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f2b4a-83ee-4a4f-a7fb-e4c39f11b708 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:37.260124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5c2eb-ab6f-4fa5-bd5b-94abb2ca499a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:37.296838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c146b-8b51-4057-a8f4-935c6ad7920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:37.297522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c146b-8b51-4057-a8f4-935c6ad7920b None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.297812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c146b-8b51-4057-a8f4-935c6ad7920b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.298095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c146b-8b51-4057-a8f4-935c6ad7920b None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.298906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c146b-8b51-4057-a8f4-935c6ad7920b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:37.300557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c146b-8b51-4057-a8f4-935c6ad7920b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:37.345669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:37.352274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f2b4a-83ee-4a4f-a7fb-e4c39f11b708 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:37.388263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:37.389429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.389915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.390432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.402867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:37.414313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:37.415230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:37.416154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:37.418501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 16/30] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:37.419509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:37.451740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 15/31] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Jun 20 18:32:37 2022] POST /identity/v3/roles => generated 225 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:37.453483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0eb9-2b25-4664-a3d5-4946e0561f76 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.453921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0eb9-2b25-4664-a3d5-4946e0561f76 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.454372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0eb9-2b25-4664-a3d5-4946e0561f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.491143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a18e0eb9-2b25-4664-a3d5-4946e0561f76 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:37.498294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a18e0eb9-2b25-4664-a3d5-4946e0561f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:37.627661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:37.635952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214d153-c181-42b7-85e0-8df7f2644a1f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:37.641427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 16/32] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:37.642532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0eb9-2b25-4664-a3d5-4946e0561f76 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:37.686655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:37.687512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.687922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.688220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.688963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:37.689276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:37.691396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:37.719502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 17/33] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:37.720345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:37.743298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:37.781333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0eb9-2b25-4664-a3d5-4946e0561f76 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:37.818773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:37.819643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.819841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.820109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.820924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:37.821242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:37.822781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:37.831662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 17/34] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:37.832458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:37.833773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b874c-1e3b-4cdc-a885-d2cc71bb2841 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:37.878953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:37.879659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.879955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.880240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.882100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:37.883928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:37.901579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:37.951026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8ca6b-5510-4e14-bd44-cc812001196a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:37.985241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0a7cd-879d-4391-a63e-8d560dcce063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:37.985916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a7cd-879d-4391-a63e-8d560dcce063 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:37.986215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a7cd-879d-4391-a63e-8d560dcce063 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:37.986505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a7cd-879d-4391-a63e-8d560dcce063 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:37.987249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0a7cd-879d-4391-a63e-8d560dcce063 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:37.988721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0a7cd-879d-4391-a63e-8d560dcce063 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:38.013442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 18/35] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Jun 20 18:32:37 2022] POST /identity/v3/roles => generated 219 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:38.014285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:38.037230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 18/36] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:32:37 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:38.039130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf770-d418-4a3f-a2e7-64c9c9df9ce3 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.039857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf770-d418-4a3f-a2e7-64c9c9df9ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.040146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf770-d418-4a3f-a2e7-64c9c9df9ce3 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.043051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 19/37] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:38.050154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697903f7-f9c1-4e6a-bdad-ce0dbd0663d4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.050489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697903f7-f9c1-4e6a-bdad-ce0dbd0663d4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.050731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697903f7-f9c1-4e6a-bdad-ce0dbd0663d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.086035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-697903f7-f9c1-4e6a-bdad-ce0dbd0663d4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:38.088523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-697903f7-f9c1-4e6a-bdad-ce0dbd0663d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:38.188534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:38.219188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e5b4-1de3-4ee7-93d2-0f1b49976804 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:38.220875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 20/38] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 20 18:32:38.222240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9509-7ef5-4b91-aa21-2510fa99b9dd None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.222534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9509-7ef5-4b91-aa21-2510fa99b9dd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.222815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9509-7ef5-4b91-aa21-2510fa99b9dd None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.227345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 21/39] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:38.234263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106d53-177b-4149-a91a-59eefa13cd6f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.234564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106d53-177b-4149-a91a-59eefa13cd6f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.234862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106d53-177b-4149-a91a-59eefa13cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.256006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-44106d53-177b-4149-a91a-59eefa13cd6f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:38.257236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-44106d53-177b-4149-a91a-59eefa13cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:38.275693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:38.276828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.277121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.277407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] PATH_INFO: `/v3/users/f899d83db9084c5aa9d23df884d32076` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.279133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f899d83db9084c5aa9d23df884d32076)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:38.280717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:38.282614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 19/40] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:38 2022] GET /identity/v3/users/f899d83db9084c5aa9d23df884d32076 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:38.283648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:38.294223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:38.338908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 22/41] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:32:38.339901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44106d53-177b-4149-a91a-59eefa13cd6f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:38.404625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91322f-53bc-43bb-ae4a-4bd95a5d72e8 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:38.441387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:38.442234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.442597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.442984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.443870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:38.445387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:38.459914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 20/42] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Jun 20 18:32:38 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:38.460779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:38.481510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:38.560608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44106d53-177b-4149-a91a-59eefa13cd6f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:38.594589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3ce6-1e1f-4705-bcd9-e2b0e499f3b8 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:38.600834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:38.601674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.601969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.602253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.604036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:38.605922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:38.608120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 23/43] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:38.613724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:38.636780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:38.637608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.637906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.638199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.640026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:38.641509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:38.643447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 21/44] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:38.649288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:38.655025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:38.726086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcdbe6-6ed1-489e-84f1-3485f2aa7f2b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:38.738537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:38.759360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c6344-f54a-49bf-bbaf-22245ff42c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:38.760251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c6344-f54a-49bf-bbaf-22245ff42c38 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.760551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c6344-f54a-49bf-bbaf-22245ff42c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.760842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c6344-f54a-49bf-bbaf-22245ff42c38 None admin] PATH_INFO: `/v3/domains/default/users/f899d83db9084c5aa9d23df884d32076/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.762875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c6344-f54a-49bf-bbaf-22245ff42c38 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f899d83db9084c5aa9d23df884d32076, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:38.763253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8f192-14ee-4bf6-ae3c-c91f809a8e73 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:38.764365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c6344-f54a-49bf-bbaf-22245ff42c38 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:38.778352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 24/45] 10.222.0.43 () {58 vars in 1361 bytes} [Mon Jun 20 18:32:38 2022] PUT /identity/v3/domains/default/users/f899d83db9084c5aa9d23df884d32076/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:32:38.799544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690295f6-58d0-45d0-9b3d-32c6766c85e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:38.800231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690295f6-58d0-45d0-9b3d-32c6766c85e9 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:38.800524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690295f6-58d0-45d0-9b3d-32c6766c85e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:38.800809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690295f6-58d0-45d0-9b3d-32c6766c85e9 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:38.801565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690295f6-58d0-45d0-9b3d-32c6766c85e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:38.803153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690295f6-58d0-45d0-9b3d-32c6766c85e9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:38.832646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 22/46] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:32:38 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:32:40.814373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3c5a-2948-4f23-b6f7-e19f485df3bb None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:40.814880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3c5a-2948-4f23-b6f7-e19f485df3bb None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:40.814985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3c5a-2948-4f23-b6f7-e19f485df3bb None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:40.816390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 25/47] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:40.822199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9ca7-0f01-46b6-ad48-35e603bade59 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:40.822596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9ca7-0f01-46b6-ad48-35e603bade59 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:40.822775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9ca7-0f01-46b6-ad48-35e603bade59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:40.839392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-78ab9ca7-0f01-46b6-ad48-35e603bade59 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:40.840902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-78ab9ca7-0f01-46b6-ad48-35e603bade59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:40.875566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd574-0090-40f2-8e1e-189f9190c2cd None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:40.875869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd574-0090-40f2-8e1e-189f9190c2cd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:40.876162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd574-0090-40f2-8e1e-189f9190c2cd None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:40.877547 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 26/48] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:32:40.883048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677837d-c7dc-4300-a53f-76110e989b17 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:40.883349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677837d-c7dc-4300-a53f-76110e989b17 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:40.883641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677837d-c7dc-4300-a53f-76110e989b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:40.900519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4677837d-c7dc-4300-a53f-76110e989b17 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:40.901730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4677837d-c7dc-4300-a53f-76110e989b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:40.907061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 23/49] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:40.930289 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9ca7-0f01-46b6-ad48-35e603bade59 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:40.968656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 27/50] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:40.983249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:40.992157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677837d-c7dc-4300-a53f-76110e989b17 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:41.018201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:41.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9ca7-0f01-46b6-ad48-35e603bade59 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:41.061541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:41.062355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:41.062651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:41.062969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:41.073464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:41.081175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:41.082066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:41.082816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 24/51] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:32:41.088040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:41.090721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677837d-c7dc-4300-a53f-76110e989b17 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:41.124744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:41.125549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:41.125841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:41.126125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:41.127344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:41.128810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:41.130784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 28/52] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:41.135857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:41.186243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880965d-b658-43fe-b6a4-d44381ccf1dd None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:41.201744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:41.219810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:41.220426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:41.220725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:41.221024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:41.221785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:41.222100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:41.223551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:41.227460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:41.234278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181bd6-a694-447d-82c9-9be6384e2165 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:41.236706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 25/53] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:41.242724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:41.268611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:41.269281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:41.269573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:41.269859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:41.270576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:41.272108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:41.304602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 29/54] 10.222.0.43 () {60 vars in 1140 bytes} [Mon Jun 20 18:32:41 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:32:41.451785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea407-74a8-45b0-a91b-b840fc78a6e8 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:41.488463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:41.489373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:41.490039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:41.490039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] PATH_INFO: `/v3/users/f899d83db9084c5aa9d23df884d32076` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:41.491261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] RBAC: Authorizing `identity:get_user(user_id=f899d83db9084c5aa9d23df884d32076)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:41.492747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:41.494398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 26/55] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:41 2022] GET /identity/v3/users/f899d83db9084c5aa9d23df884d32076 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:41.500059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:41.598686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b522a18-5dc1-4dee-982b-a30e00cb6304 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:41.631570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041ae7-16b8-4818-8c85-36a45560c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:41.632392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041ae7-16b8-4818-8c85-36a45560c195 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:41.632665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041ae7-16b8-4818-8c85-36a45560c195 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:41.632942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041ae7-16b8-4818-8c85-36a45560c195 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:41.634102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041ae7-16b8-4818-8c85-36a45560c195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:41.635607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041ae7-16b8-4818-8c85-36a45560c195 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:41.637230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 30/56] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:41.643161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:41.689554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:41.746190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493e9fe-eb97-4ef8-a741-d5004a8ff261 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:41.778793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bc3be-da64-4242-883e-2c8c6c396407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:41.779507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc3be-da64-4242-883e-2c8c6c396407 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:41.779810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc3be-da64-4242-883e-2c8c6c396407 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:41.780101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc3be-da64-4242-883e-2c8c6c396407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:41.781200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bc3be-da64-4242-883e-2c8c6c396407 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.domain.id=default, user.id=f899d83db9084c5aa9d23df884d32076) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:41.781521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bc3be-da64-4242-883e-2c8c6c396407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:41.783015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bc3be-da64-4242-883e-2c8c6c396407 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:41.792246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 27/57] 10.222.0.43 () {56 vars in 1322 bytes} [Mon Jun 20 18:32:41 2022] GET /identity/v3/role_assignments?user.id=f899d83db9084c5aa9d23df884d32076&scope.domain.id=default&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:43.323287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50fe3-0230-4ea3-972b-43d04fb85bc2 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:43.323799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50fe3-0230-4ea3-972b-43d04fb85bc2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:43.323880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50fe3-0230-4ea3-972b-43d04fb85bc2 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:43.325218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 31/58] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:43.330341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69b463-27f1-4a50-aafc-32426453e8b7 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:43.330703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69b463-27f1-4a50-aafc-32426453e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:43.330948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69b463-27f1-4a50-aafc-32426453e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:43.347654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3d69b463-27f1-4a50-aafc-32426453e8b7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:43.348841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3d69b463-27f1-4a50-aafc-32426453e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:43.413248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 28/59] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:43.436718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50fe3-0230-4ea3-972b-43d04fb85bc2 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:43.453330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:43.539461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50fe3-0230-4ea3-972b-43d04fb85bc2 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:43.571228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267e0a-2401-4f7d-a329-0d6c27d2b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:43.572020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267e0a-2401-4f7d-a329-0d6c27d2b125 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:43.572312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267e0a-2401-4f7d-a329-0d6c27d2b125 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:43.572596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267e0a-2401-4f7d-a329-0d6c27d2b125 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:43.573809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267e0a-2401-4f7d-a329-0d6c27d2b125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:43.575236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267e0a-2401-4f7d-a329-0d6c27d2b125 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:43.576825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 32/60] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:43.582209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69b463-27f1-4a50-aafc-32426453e8b7 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:43.622252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:43.679472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69b463-27f1-4a50-aafc-32426453e8b7 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:43.715503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f051d-718b-483d-9951-0ba1302ab050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:43.716186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f051d-718b-483d-9951-0ba1302ab050 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:43.716474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f051d-718b-483d-9951-0ba1302ab050 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:43.716752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f051d-718b-483d-9951-0ba1302ab050 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:43.717462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f051d-718b-483d-9951-0ba1302ab050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:43.718934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f051d-718b-483d-9951-0ba1302ab050 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:43.743573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 29/61] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:32:43 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:46.855582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33081d14-bba6-4fcf-8621-db444b558078 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:46.856452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33081d14-bba6-4fcf-8621-db444b558078 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:46.856881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33081d14-bba6-4fcf-8621-db444b558078 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:46.858712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 33/62] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:46.863830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b05ca-c638-4d5d-a125-4923fad0cf64 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:46.864264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b05ca-c638-4d5d-a125-4923fad0cf64 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:46.864615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b05ca-c638-4d5d-a125-4923fad0cf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:46.887921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-378b05ca-c638-4d5d-a125-4923fad0cf64 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:46.889152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-378b05ca-c638-4d5d-a125-4923fad0cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:46.984940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 30/63] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:46.994584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a2cd-9582-413c-a8a1-490e80907e05 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:46.995159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a2cd-9582-413c-a8a1-490e80907e05 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:46.995661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a2cd-9582-413c-a8a1-490e80907e05 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:46.998472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 34/64] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:47.002793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a9ba-c374-4e15-b6b1-08f798c435d7 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.003122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a9ba-c374-4e15-b6b1-08f798c435d7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.003414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a9ba-c374-4e15-b6b1-08f798c435d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.016171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4a2cd-9582-413c-a8a1-490e80907e05 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.031544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1671a9ba-c374-4e15-b6b1-08f798c435d7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:47.032857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1671a9ba-c374-4e15-b6b1-08f798c435d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:47.060808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.114412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.127003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 31/65] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:47.128610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8e62-9d9a-45f4-b4f7-59a1de17fd4d None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.129034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8e62-9d9a-45f4-b4f7-59a1de17fd4d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.129447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8e62-9d9a-45f4-b4f7-59a1de17fd4d None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.132961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 32/66] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:47.144282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cdf02-04a8-4d8f-94b5-65ddc59e6e33 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.144792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cdf02-04a8-4d8f-94b5-65ddc59e6e33 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.145226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cdf02-04a8-4d8f-94b5-65ddc59e6e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.151523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4a2cd-9582-413c-a8a1-490e80907e05 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.164859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-582cdf02-04a8-4d8f-94b5-65ddc59e6e33 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:47.166226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-582cdf02-04a8-4d8f-94b5-65ddc59e6e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:47.192742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.194461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.194965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.195420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.206827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:47.216436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:47.217387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:47.218188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:47.220760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 35/67] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:47.221798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.236740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 33/68] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:47.237523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cdf02-04a8-4d8f-94b5-65ddc59e6e33 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.341052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.358815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cdf02-04a8-4d8f-94b5-65ddc59e6e33 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.365879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a87a-f0a6-4f4e-af5d-21a845716911 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.395837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.396798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.397227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.397671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.398563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:47.399126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:47.400719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:47.409760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:47.411046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.411384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.412857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.413151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.413434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.427686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:47.436970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:47.437820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:32:47.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:47.441247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:47.447572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.451661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.522302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47432af3-1fdc-46bc-b7b7-6b092d306fee None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.548978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2f402-18af-4412-b0be-7c0a86a4eedc None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.554575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.555411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.555703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.555983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.565723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:47.573918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:47.574805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:47.580423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.583133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f735-67b0-4ed7-9183-11372b53431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.584033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f735-67b0-4ed7-9183-11372b53431d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.584327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f735-67b0-4ed7-9183-11372b53431d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.584610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f735-67b0-4ed7-9183-11372b53431d None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.587309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.598009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f735-67b0-4ed7-9183-11372b53431d None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:47.599572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f735-67b0-4ed7-9183-11372b53431d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:47.601278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:47.606872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2cca0-ae93-4119-95d5-77221f097c54 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.607201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2cca0-ae93-4119-95d5-77221f097c54 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.607491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2cca0-ae93-4119-95d5-77221f097c54 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.608753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 38/73] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:47.609852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd68f-68ad-4dd5-9602-344d4683c3b2 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.610113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd68f-68ad-4dd5-9602-344d4683c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.610397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd68f-68ad-4dd5-9602-344d4683c3b2 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.611654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 39/74] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:47.616041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dd68f-68ad-4dd5-9602-344d4683c3b2 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.675640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.679574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd38c2a-060a-41fc-94a9-e5f20adf80b7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.715386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.716073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.716366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.716655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.717409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:47.717726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:47.719136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:47.721451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dd68f-68ad-4dd5-9602-344d4683c3b2 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.727102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 36/75] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:47.727898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.756909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f4dcf-7385-4383-b405-bd7787fef3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.757580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4dcf-7385-4383-b405-bd7787fef3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.757898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4dcf-7385-4383-b405-bd7787fef3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.758182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4dcf-7385-4383-b405-bd7787fef3f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.758963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f4dcf-7385-4383-b405-bd7787fef3f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:47.759276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f4dcf-7385-4383-b405-bd7787fef3f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:47.760666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f4dcf-7385-4383-b405-bd7787fef3f9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:47.768554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 40/76] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:47.773131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1b3d4-a697-41a8-b728-70123f83f7cc None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.773131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1b3d4-a697-41a8-b728-70123f83f7cc None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.773131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1b3d4-a697-41a8-b728-70123f83f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.786294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8da1b3d4-a697-41a8-b728-70123f83f7cc None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:47.787530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8da1b3d4-a697-41a8-b728-70123f83f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:47.799978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.831575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e67240-6bc2-43ab-983d-dcdfb82f75df None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:47.852329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 41/77] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:47.867043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24231d-fbd3-41ed-a21c-694e9992949d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.867043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24231d-fbd3-41ed-a21c-694e9992949d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.867043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24231d-fbd3-41ed-a21c-694e9992949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.867667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:47.868002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:47.868080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:47.877016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:47.877147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1e24231d-fbd3-41ed-a21c-694e9992949d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:47.877147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1e24231d-fbd3-41ed-a21c-694e9992949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:47.916699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:47.935712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:47.936643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 42/78] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:47.937457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24231d-fbd3-41ed-a21c-694e9992949d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:47.943564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.009998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.033925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24231d-fbd3-41ed-a21c-694e9992949d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.042724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 37/79] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:32:48.043376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.074091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.075004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.075294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.075576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.076762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.078224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.079885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 43/80] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:47 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:48.081770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.130371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.142175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279c651-bfdd-40af-8de4-79432a1e00b1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.175829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.176714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.177005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.177819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] PATH_INFO: `/v3/users/f899d83db9084c5aa9d23df884d32076` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.179036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] RBAC: Authorizing `identity:get_user(user_id=f899d83db9084c5aa9d23df884d32076)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.180110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe729cac-6834-400d-bbe8-3909e6206ed0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.180496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.182114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 38/81] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/users/f899d83db9084c5aa9d23df884d32076 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:48.182876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.213649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.214447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.214738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.215054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.216219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.217710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.219349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 44/82] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:48.223477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.224941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.282508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac0339-804f-4afd-8a26-9cf6c8bf067d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.315551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.316288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.316581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.316869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.320582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62fc0-d7e7-4a73-807f-29cc481489a6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.326980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:48.335284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:48.336288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:48.337115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 39/83] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:48.337736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.340316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.358063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.358959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.359256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.359544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.360730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.362206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.363939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 45/84] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:48.365190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.435404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.438973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b0d-083b-4278-b1b8-7e41e41c0ba0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.462049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be10d2-9239-41b3-bb72-a3f2ffdd123f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.472143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.472807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.473101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.473388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.495822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.496470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.496765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.497044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.538951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.540414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.551009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.565012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.566529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.632782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.642316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 40/85] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:32:48.643235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.670531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 46/86] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:32:48.670531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.748291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987f77-a254-4278-8a27-e80306d8f4b0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.749135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.763792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f022-861a-4688-9d05-87a14aa0af0a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.781183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.781859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.782151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.782436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.783188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.784642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.796812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.797480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.797772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.798054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.798947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:48.799150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.800524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.804114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 41/87] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:32:48 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:48.823210 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.823322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 47/88] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:48.823322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.869073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:48.919567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928a520-1461-48cc-9d48-1db601ddf026 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.930131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f26ea-00e5-458c-bdd3-4d6cde5168c3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:48.954854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.955557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.956446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.956446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.956959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=33de371567f9414098226ad9427441e5, user.id=e717eaf0c527468cbf87f65de0f065e5) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:48.958068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.959261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.965442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 42/89] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/role_assignments?user.id=e717eaf0c527468cbf87f65de0f065e5&scope.project.id=33de371567f9414098226ad9427441e5&role.id=a73d3b84962843cdb2898ec86046e88e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:48.966380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:48.969601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:48.970494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:48.970781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:48.971104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:48.972357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:48.973872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:48.976431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 48/90] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:48.982043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:49.006788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:49.108400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546f3c-009e-441f-b931-90d28f53819d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:49.123789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fa843-90df-4b12-8057-17661bf68f08 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:49.127481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:49.155141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:49.156294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:49.156585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:49.156867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:49.158224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:49.159716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:49.161441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 43/91] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:49.164387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:49.188393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:49.190165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:49.190892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:49.191399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:49.193462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:49.195786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:49.198327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 49/92] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:48 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:49.199560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:49.289544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9397e-2308-4790-b0a0-b564f3b4ec6d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:49.304290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:49.323853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48536a-7f87-4491-9958-7f43e5422317 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:49.336324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:49.337329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:49.337912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:49.338428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:49.339627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] RBAC: Adding query filter params (role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=33de371567f9414098226ad9427441e5, user.id=e717eaf0c527468cbf87f65de0f065e5) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:49.340141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:49.342022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:49.348606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 44/93] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:32:49 2022] GET /identity/v3/role_assignments?user.id=e717eaf0c527468cbf87f65de0f065e5&scope.project.id=33de371567f9414098226ad9427441e5&role.id=c9b4590007f942458d155393f4a0da83 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:49.350370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:49.376208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:49.376544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:49.376767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:49.377050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:49.377917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=33de371567f9414098226ad9427441e5, user.id=f899d83db9084c5aa9d23df884d32076) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:49.378236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:49.379798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:49.386516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 50/94] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:32:49 2022] GET /identity/v3/role_assignments?user.id=f899d83db9084c5aa9d23df884d32076&scope.project.id=33de371567f9414098226ad9427441e5&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:49.414426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:49.478896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcf6d9-9833-4765-82a5-8774b5a00eea None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:49.520334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:49.522122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:49.522626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:49.523164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:49.602590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:49.604469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:49.660016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:49.717668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 45/95] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:32:49.723241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:49.856785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62643d87-0254-47fb-a7ac-884365c07ec3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:49.908531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5f27a-d20f-4847-a892-c3c1f3edd773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:49.909430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5f27a-d20f-4847-a892-c3c1f3edd773 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:49.909723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5f27a-d20f-4847-a892-c3c1f3edd773 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:49.910009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5f27a-d20f-4847-a892-c3c1f3edd773 None admin] PATH_INFO: `/v3/projects/4e6a2b2459fd41afb35386213c30be51` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:49.911333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5f27a-d20f-4847-a892-c3c1f3edd773 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6a2b2459fd41afb35386213c30be51)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:49.913351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5f27a-d20f-4847-a892-c3c1f3edd773 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:49.915108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 51/96] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:49 2022] GET /identity/v3/projects/4e6a2b2459fd41afb35386213c30be51 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:49.921419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:50.039687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa7a30-20d5-4802-9985-09be0e155161 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:50.086930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b49d09-62c5-4bc5-a4fa-36c6c18dbb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:50.087872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b49d09-62c5-4bc5-a4fa-36c6c18dbb00 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:50.088307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b49d09-62c5-4bc5-a4fa-36c6c18dbb00 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:50.088731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b49d09-62c5-4bc5-a4fa-36c6c18dbb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:50.089718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b49d09-62c5-4bc5-a4fa-36c6c18dbb00 None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=4e6a2b2459fd41afb35386213c30be51, user.id=e717eaf0c527468cbf87f65de0f065e5) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:50.090191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b49d09-62c5-4bc5-a4fa-36c6c18dbb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:50.091813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b49d09-62c5-4bc5-a4fa-36c6c18dbb00 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:50.097914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 46/97] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:32:49 2022] GET /identity/v3/role_assignments?user.id=e717eaf0c527468cbf87f65de0f065e5&scope.project.id=4e6a2b2459fd41afb35386213c30be51&role.id=a73d3b84962843cdb2898ec86046e88e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:51.558683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175f59-79a7-4f60-8f62-be84e3bf6ee4 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:51.559238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175f59-79a7-4f60-8f62-be84e3bf6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:51.559341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175f59-79a7-4f60-8f62-be84e3bf6ee4 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:51.560808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 52/98] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:51.566248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f467f-695d-4375-92c5-15f70f95a45f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:51.566645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f467f-695d-4375-92c5-15f70f95a45f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:51.566823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f467f-695d-4375-92c5-15f70f95a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:51.588682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-9b4f467f-695d-4375-92c5-15f70f95a45f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:51.589879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9b4f467f-695d-4375-92c5-15f70f95a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:51.600133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:51.677793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 47/99] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:51.722178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175f59-79a7-4f60-8f62-be84e3bf6ee4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:51.752386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:51.855940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175f59-79a7-4f60-8f62-be84e3bf6ee4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:51.891894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c11bc-fe03-4075-8e82-1b1b9e8f5443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:51.893047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c11bc-fe03-4075-8e82-1b1b9e8f5443 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:51.893536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c11bc-fe03-4075-8e82-1b1b9e8f5443 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:51.894034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c11bc-fe03-4075-8e82-1b1b9e8f5443 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:51.904865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c11bc-fe03-4075-8e82-1b1b9e8f5443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-747c11bc-fe03-4075-8e82-1b1b9e8f5443 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:51.913786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:51.914678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:32:51.915471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:51.917821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 53/100] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:51.924029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f467f-695d-4375-92c5-15f70f95a45f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:51.977430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1624b-7520-41b6-bbf8-e80091ac45f8 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:51.978197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1624b-7520-41b6-bbf8-e80091ac45f8 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:51.978678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1624b-7520-41b6-bbf8-e80091ac45f8 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:51.980732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 54/101] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:51.985436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91965fb-bbed-4dcc-9b0b-5d6127321462 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:51.985947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91965fb-bbed-4dcc-9b0b-5d6127321462 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:51.986426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91965fb-bbed-4dcc-9b0b-5d6127321462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.008925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d91965fb-bbed-4dcc-9b0b-5d6127321462 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:52.010528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d91965fb-bbed-4dcc-9b0b-5d6127321462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:52.047424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f467f-695d-4375-92c5-15f70f95a45f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:52.089524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 55/102] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:52.096499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15a8df-c2cb-41b1-8c55-c0fc69b233db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:52.097413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a8df-c2cb-41b1-8c55-c0fc69b233db None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.097921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a8df-c2cb-41b1-8c55-c0fc69b233db None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.098402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a8df-c2cb-41b1-8c55-c0fc69b233db None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.100026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15a8df-c2cb-41b1-8c55-c0fc69b233db None admin] RBAC: Adding query filter params (name=reader) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:52.100546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15a8df-c2cb-41b1-8c55-c0fc69b233db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:52.102114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15a8df-c2cb-41b1-8c55-c0fc69b233db None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:52.111564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 48/103] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:32:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:52.120034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91965fb-bbed-4dcc-9b0b-5d6127321462 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:52.132511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:52.168272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a008-be76-4169-a724-61d61c3337cc None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.168585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a008-be76-4169-a724-61d61c3337cc None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.168804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a008-be76-4169-a724-61d61c3337cc None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.177694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 49/104] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:32:52.177694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92a46-e5d9-4000-b618-d5a651970a4d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.177694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92a46-e5d9-4000-b618-d5a651970a4d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.177694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d92a46-e5d9-4000-b618-d5a651970a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.191269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:52.195799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-75d92a46-e5d9-4000-b618-d5a651970a4d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:52.197432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-75d92a46-e5d9-4000-b618-d5a651970a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:52.295893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 50/105] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:32:52.303199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d92a46-e5d9-4000-b618-d5a651970a4d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:52.311429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91965fb-bbed-4dcc-9b0b-5d6127321462 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:52.370183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:52.371083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.371403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.371657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] PATH_INFO: `/v3/users/e23a9d2b02be4431992c3a875ac566ba` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.385786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] RBAC: Authorizing `identity:get_user(user_id=e23a9d2b02be4431992c3a875ac566ba)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:52.387310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:52.389032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 56/106] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:52 2022] GET /identity/v3/users/e23a9d2b02be4431992c3a875ac566ba => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:52.390069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:52.456430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:52.457074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d92a46-e5d9-4000-b618-d5a651970a4d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:52.493349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda17f9-c89e-44f6-80a1-652f6abcb5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:52.494563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda17f9-c89e-44f6-80a1-652f6abcb5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.495114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda17f9-c89e-44f6-80a1-652f6abcb5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.495596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda17f9-c89e-44f6-80a1-652f6abcb5e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.496978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda17f9-c89e-44f6-80a1-652f6abcb5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:52.497536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243107d-4342-4a03-94d2-8811f4370565 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:52.498861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda17f9-c89e-44f6-80a1-652f6abcb5e3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:52.500991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 51/107] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:52.502427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3565f-ff97-433f-a324-42972a26fca6 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.502881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3565f-ff97-433f-a324-42972a26fca6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.503358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3565f-ff97-433f-a324-42972a26fca6 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.504781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 52/108] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:52.505681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3565f-ff97-433f-a324-42972a26fca6 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:52.509615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:52.541482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f02903-d73e-4d0d-b1fe-5691b36c3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:52.542531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f02903-d73e-4d0d-b1fe-5691b36c3c1d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.542988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f02903-d73e-4d0d-b1fe-5691b36c3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.543385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f02903-d73e-4d0d-b1fe-5691b36c3c1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.557889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f02903-d73e-4d0d-b1fe-5691b36c3c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-86f02903-d73e-4d0d-b1fe-5691b36c3c1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:52.568383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:52.569688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 57/109] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:52.575689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e2fa-4620-4d9d-91e6-7a28f6a2c62a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.576392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e2fa-4620-4d9d-91e6-7a28f6a2c62a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.576392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e2fa-4620-4d9d-91e6-7a28f6a2c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.596513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3f40e2fa-4620-4d9d-91e6-7a28f6a2c62a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:52.598068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3f40e2fa-4620-4d9d-91e6-7a28f6a2c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:52.635101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3565f-ff97-433f-a324-42972a26fca6 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:52.671094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 58/110] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:52.671917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40e2fa-4620-4d9d-91e6-7a28f6a2c62a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:52.676346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9bf85-d2b2-48fc-901a-ebe8f79680ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:52.677528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bf85-d2b2-48fc-901a-ebe8f79680ff None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.678014 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bf85-d2b2-48fc-901a-ebe8f79680ff None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.678487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bf85-d2b2-48fc-901a-ebe8f79680ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.736843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:52.759438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9bf85-d2b2-48fc-901a-ebe8f79680ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:52.760922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9bf85-d2b2-48fc-901a-ebe8f79680ff None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:52.763549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:52.788097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40e2fa-4620-4d9d-91e6-7a28f6a2c62a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:52.824196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:52.824868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.825206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.825487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.826224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:52.827705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:52.862957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 59/111] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:32:52 2022] POST /identity/v3/projects => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:52.862957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:52.876406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 53/112] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:32:52.878004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde2e31-1b13-4f02-81b1-d816d12e85de None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:52.878303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde2e31-1b13-4f02-81b1-d816d12e85de None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:52.878588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde2e31-1b13-4f02-81b1-d816d12e85de None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:52.880107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 54/113] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:52.881543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde2e31-1b13-4f02-81b1-d816d12e85de None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.000944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60462699-a025-4b31-864f-91e5f81d9425 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.003584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde2e31-1b13-4f02-81b1-d816d12e85de None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.007722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.012829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.057015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a120bde-5f1d-43d5-bb5a-ad9132549d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.058499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a120bde-5f1d-43d5-bb5a-ad9132549d53 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.058499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a120bde-5f1d-43d5-bb5a-ad9132549d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.058499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a120bde-5f1d-43d5-bb5a-ad9132549d53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.059662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.060111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.061089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.061089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.061455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:53.062044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.063551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.073375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 60/114] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:32:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.076415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a120bde-5f1d-43d5-bb5a-ad9132549d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:53.078519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-4a120bde-5f1d-43d5-bb5a-ad9132549d53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:53.085542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:53.086449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:53.087666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 55/115] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:32:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:53.088317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0671c1-bceb-4ea8-960d-479cba9027f9 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.088317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0671c1-bceb-4ea8-960d-479cba9027f9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.088687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0671c1-bceb-4ea8-960d-479cba9027f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.106425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2c0671c1-bceb-4ea8-960d-479cba9027f9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:53.107765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2c0671c1-bceb-4ea8-960d-479cba9027f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:53.194815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d86a-6198-4ea8-bd7a-edf3b3978ad9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.201411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 56/116] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:53.203201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0671c1-bceb-4ea8-960d-479cba9027f9 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.232093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.232989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.233283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.233569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.235117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.236953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.238804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 61/117] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.240458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.281914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.323471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.332151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0671c1-bceb-4ea8-960d-479cba9027f9 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.353131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b72f-6f2b-4b75-823c-a8ed2055d6b9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.367465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.368367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.368660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.368945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.370145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.371656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.373312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 57/118] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.375021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.395428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.396256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.396550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.396831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.397691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:53.398004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.399546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.408478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 62/119] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.409359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.482202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3b8ea-cffb-4d26-a066-9f8d6f99323a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.504870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.508862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023087-bcdc-465c-8d1f-b6938847aa1b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.520137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9e62-35f7-49be-8e12-aecdfebbbd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.521651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9e62-35f7-49be-8e12-aecdfebbbd6d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.522086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9e62-35f7-49be-8e12-aecdfebbbd6d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.522720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9e62-35f7-49be-8e12-aecdfebbbd6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.537121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9e62-35f7-49be-8e12-aecdfebbbd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:53.548672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.549343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.549632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.549917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.550762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] RBAC: Adding query filter params (role.id=118a743b3fb844bf8f61de225e3365b2, scope.project.id=33de371567f9414098226ad9427441e5, user.id=e23a9d2b02be4431992c3a875ac566ba) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:53.551111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-c20b9e62-35f7-49be-8e12-aecdfebbbd6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:53.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:53.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:53.553316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:53.554120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.556541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 58/120] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:53.558079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316d80-9f29-4f4a-ae4c-4ad92db01a40 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.558376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316d80-9f29-4f4a-ae4c-4ad92db01a40 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.558665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316d80-9f29-4f4a-ae4c-4ad92db01a40 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.563952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 59/121] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:53.563952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316d80-9f29-4f4a-ae4c-4ad92db01a40 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.566131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 63/122] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/role_assignments?user.id=e23a9d2b02be4431992c3a875ac566ba&scope.project.id=33de371567f9414098226ad9427441e5&role.id=118a743b3fb844bf8f61de225e3365b2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.567156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.593893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.699164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316d80-9f29-4f4a-ae4c-4ad92db01a40 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.718141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9cdaf-41f8-432a-8447-85806bcd644b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.745260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.746659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.747091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.747415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.751155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.752719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.754993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 60/123] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.756772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.768046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6efa06-78f6-43a2-8885-0f840b0cff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.769329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efa06-78f6-43a2-8885-0f840b0cff86 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.769947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efa06-78f6-43a2-8885-0f840b0cff86 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.770468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efa06-78f6-43a2-8885-0f840b0cff86 None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.772538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6efa06-78f6-43a2-8885-0f840b0cff86 None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.774364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6efa06-78f6-43a2-8885-0f840b0cff86 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.776605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 64/124] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.778129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53faf-c4c0-4273-a5ca-b0927050c063 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.778661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53faf-c4c0-4273-a5ca-b0927050c063 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.779203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53faf-c4c0-4273-a5ca-b0927050c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.798297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-59a53faf-c4c0-4273-a5ca-b0927050c063 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:53.800299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-59a53faf-c4c0-4273-a5ca-b0927050c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:53.839283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.855115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:53.867231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b99a-c23f-44ad-87da-05a5ac6730ef None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:53.902942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 65/125] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:53.902942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53faf-c4c0-4273-a5ca-b0927050c063 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:53.914333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:53.915420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:53.915875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:53.916298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:53.917239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:53.917701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:53.919546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:53.945189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 61/126] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:53.945969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.017905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53faf-c4c0-4273-a5ca-b0927050c063 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.067466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8285d-7b5e-4bba-b145-eeaada074e16 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.071618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.072692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.073121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.073542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5/users/e717eaf0c527468cbf87f65de0f065e5/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.075725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] RBAC: Authorizing `identity:create_grant(project_id=33de371567f9414098226ad9427441e5, user_id=e717eaf0c527468cbf87f65de0f065e5, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.077437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.093904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 66/127] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:32:53 2022] PUT /identity/v3/projects/33de371567f9414098226ad9427441e5/users/e717eaf0c527468cbf87f65de0f065e5/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:32:54.094747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.114305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.116076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.117120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.117671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.119303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.120619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:54.123505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.127175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 62/128] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:53 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:54.134185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.183788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:54.286993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1ade-966b-44e3-8c39-87349b65260f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.324679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b5044-2138-4734-8a04-f0ee7a53ae5b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.328901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.330054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.330598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.331160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.343255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:54.352044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:54.352915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:54.353688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:54.363000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 67/129] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:54.365159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.368123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.369026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.369318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.369601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] PATH_INFO: `/v3/users/f899d83db9084c5aa9d23df884d32076` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.371513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] RBAC: Authorizing `identity:get_user(user_id=f899d83db9084c5aa9d23df884d32076)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.372331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.374120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 63/130] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:54 2022] GET /identity/v3/users/f899d83db9084c5aa9d23df884d32076 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:54.374795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.465376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:54.469309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:54.478241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327374-2128-4a64-9e61-b2f95ca9c440 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.492482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161ba0-eb84-4a25-9c65-ab9cf984c823 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.512716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.513404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.513693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.513975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.514731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:54.515074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.516477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.524907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 64/131] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:54.525704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.533235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.534520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.535119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.535604 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5/users/e717eaf0c527468cbf87f65de0f065e5/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.538259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=33de371567f9414098226ad9427441e5, user_id=e717eaf0c527468cbf87f65de0f065e5, role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.540100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.558165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 68/132] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:32:54 2022] PUT /identity/v3/projects/33de371567f9414098226ad9427441e5/users/e717eaf0c527468cbf87f65de0f065e5/roles/c9b4590007f942458d155393f4a0da83 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:32:54.559773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.698012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f769b2-debe-4194-b73d-3d607c3446c6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.728952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1353e-66b1-4253-bf71-a69d435dcfe5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.744633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.745649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.745949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.746235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.747771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.750000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.752426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 69/133] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:54 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:54.758568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.774309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:54.824359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.825256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.825546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.825840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.828412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.829898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.831970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 65/134] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:54 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:54.846355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:54.873320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:54.892071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0aaf0-29d7-4626-907c-6615ad7fc4c0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:54.933479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:54.934371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:54.934661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:54.934963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] PATH_INFO: `/v3/projects/4e6a2b2459fd41afb35386213c30be51` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:54.936189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6a2b2459fd41afb35386213c30be51)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:54.937663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:54.939559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 70/135] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:54 2022] GET /identity/v3/projects/4e6a2b2459fd41afb35386213c30be51 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:54.956078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:55.007380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b2f2e-5bfc-4e0f-8bbf-6b9e4153dc1c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:55.061533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75799b-bcdd-442c-a0de-8cdc75f40ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:55.062095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75799b-bcdd-442c-a0de-8cdc75f40ea7 None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:55.062389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75799b-bcdd-442c-a0de-8cdc75f40ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:55.062676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75799b-bcdd-442c-a0de-8cdc75f40ea7 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5/users/f899d83db9084c5aa9d23df884d32076/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:55.068809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75799b-bcdd-442c-a0de-8cdc75f40ea7 None admin] RBAC: Authorizing `identity:create_grant(project_id=33de371567f9414098226ad9427441e5, user_id=f899d83db9084c5aa9d23df884d32076, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:55.070298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75799b-bcdd-442c-a0de-8cdc75f40ea7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:55.101654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 66/136] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:32:54 2022] PUT /identity/v3/projects/33de371567f9414098226ad9427441e5/users/f899d83db9084c5aa9d23df884d32076/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:32:55.135302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:55.170141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4ce0-6e9c-4745-9357-c0a5c115ec34 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:55.225206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:55.226228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:55.226614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:55.227018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] PATH_INFO: `/v3/projects/4e6a2b2459fd41afb35386213c30be51/users/e717eaf0c527468cbf87f65de0f065e5/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:55.229986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276f671-73d9-4602-a9a5-e12d9c08dd5f None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:55.230282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276f671-73d9-4602-a9a5-e12d9c08dd5f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:55.230569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276f671-73d9-4602-a9a5-e12d9c08dd5f None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:55.231842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e6a2b2459fd41afb35386213c30be51, user_id=e717eaf0c527468cbf87f65de0f065e5, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:55.232232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 67/137] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:32:55.233555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:55.238425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e46a0-6323-479f-85b5-0dcf47be2d59 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:55.239124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e46a0-6323-479f-85b5-0dcf47be2d59 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:55.239721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e46a0-6323-479f-85b5-0dcf47be2d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:55.255407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 71/138] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:32:54 2022] PUT /identity/v3/projects/4e6a2b2459fd41afb35386213c30be51/users/e717eaf0c527468cbf87f65de0f065e5/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:32:55.260201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4e3e46a0-6323-479f-85b5-0dcf47be2d59 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:55.261775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4e3e46a0-6323-479f-85b5-0dcf47be2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:55.341479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 68/139] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:32:55.368968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:55.495618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880db66-66e0-46aa-91b4-964d5c070664 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:55.538065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477624c-2b7e-4a7c-b89a-8c6581f315a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:55.538891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477624c-2b7e-4a7c-b89a-8c6581f315a8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:55.539211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477624c-2b7e-4a7c-b89a-8c6581f315a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:55.539500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477624c-2b7e-4a7c-b89a-8c6581f315a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:55.540720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477624c-2b7e-4a7c-b89a-8c6581f315a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:55.542194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477624c-2b7e-4a7c-b89a-8c6581f315a8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:55.543864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 72/140] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:32:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:32:55.549775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e46a0-6323-479f-85b5-0dcf47be2d59 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:55.568392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:55.667232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e46a0-6323-479f-85b5-0dcf47be2d59 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:55.709668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5466ca-8cc7-485c-80ae-cdcc3486935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:55.715860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5466ca-8cc7-485c-80ae-cdcc3486935f None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:55.716297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5466ca-8cc7-485c-80ae-cdcc3486935f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:55.716724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5466ca-8cc7-485c-80ae-cdcc3486935f None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:55.717627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5466ca-8cc7-485c-80ae-cdcc3486935f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:55.719256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5466ca-8cc7-485c-80ae-cdcc3486935f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:55.746344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 69/141] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:32:55 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:32:56.184545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5863-4bac-4d62-863b-067751f09835 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:56.185039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5863-4bac-4d62-863b-067751f09835 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:56.185307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5863-4bac-4d62-863b-067751f09835 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:56.186997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 73/142] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:56.192224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285adc2-273d-4cb6-8517-8f648b2e776b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:56.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285adc2-273d-4cb6-8517-8f648b2e776b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:56.192858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285adc2-273d-4cb6-8517-8f648b2e776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:56.219962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-8285adc2-273d-4cb6-8517-8f648b2e776b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:56.221159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8285adc2-273d-4cb6-8517-8f648b2e776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:56.299888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:56.308963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 70/143] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:56.344030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc5863-4bac-4d62-863b-067751f09835 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:56.349502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:56.462371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc5863-4bac-4d62-863b-067751f09835 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:56.500857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:56.501669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:56.501951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:56.502225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:56.515845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:56.524271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:56.525114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:56.525882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 74/144] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:56.533064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285adc2-273d-4cb6-8517-8f648b2e776b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:56.636355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285adc2-273d-4cb6-8517-8f648b2e776b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:56.685543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:56.686250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:56.686545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:56.686833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:56.687638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:56.687966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:56.689365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:56.698514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 71/145] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:32:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:56.704799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:56.807877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:56.859654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07112ec-b20b-40b7-a885-879b48d16cb3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:56.901097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:56.901989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:56.902274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:56.902554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] PATH_INFO: `/v3/users/e23a9d2b02be4431992c3a875ac566ba` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:56.903796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] RBAC: Authorizing `identity:get_user(user_id=e23a9d2b02be4431992c3a875ac566ba)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:56.905264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:56.907477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 75/146] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:56 2022] GET /identity/v3/users/e23a9d2b02be4431992c3a875ac566ba => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:56.913339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:57.014682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:57.074940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee47a2-7000-44d1-b53b-fc1253c0ed76 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:57.114211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfd558-a364-4f57-8af7-1faf79df6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:57.115679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd558-a364-4f57-8af7-1faf79df6fef None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:57.115969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd558-a364-4f57-8af7-1faf79df6fef None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:57.116253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd558-a364-4f57-8af7-1faf79df6fef None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:57.117488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfd558-a364-4f57-8af7-1faf79df6fef None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:57.118965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfd558-a364-4f57-8af7-1faf79df6fef None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:57.120677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 72/147] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:56 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:57.126417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:57.276463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413641-81d7-47b4-8567-1c70fe522b45 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:57.321984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:57.327633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68144c1c-4302-4bf6-9157-94979ed48537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:57.328613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68144c1c-4302-4bf6-9157-94979ed48537 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:57.328903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68144c1c-4302-4bf6-9157-94979ed48537 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:57.329187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68144c1c-4302-4bf6-9157-94979ed48537 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5/users/e23a9d2b02be4431992c3a875ac566ba/roles/118a743b3fb844bf8f61de225e3365b2` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:57.336262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68144c1c-4302-4bf6-9157-94979ed48537 None admin] RBAC: Authorizing `identity:create_grant(project_id=33de371567f9414098226ad9427441e5, user_id=e23a9d2b02be4431992c3a875ac566ba, role_id=118a743b3fb844bf8f61de225e3365b2)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:57.337752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68144c1c-4302-4bf6-9157-94979ed48537 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:57.366061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 76/148] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:32:57 2022] PUT /identity/v3/projects/33de371567f9414098226ad9427441e5/users/e23a9d2b02be4431992c3a875ac566ba/roles/118a743b3fb844bf8f61de225e3365b2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:32:57.616412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a873-b2bf-4d1e-8bde-56a65b5c2a9e None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:57.616754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a873-b2bf-4d1e-8bde-56a65b5c2a9e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:57.616941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a873-b2bf-4d1e-8bde-56a65b5c2a9e None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:57.618582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 73/149] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:57.624256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7e4d-0005-43c4-accc-5d88ae82332f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:57.624555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7e4d-0005-43c4-accc-5d88ae82332f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:57.624842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7e4d-0005-43c4-accc-5d88ae82332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:57.653032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-127c7e4d-0005-43c4-accc-5d88ae82332f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:57.654233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-127c7e4d-0005-43c4-accc-5d88ae82332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:57.741191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 77/150] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:57.788426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48a873-b2bf-4d1e-8bde-56a65b5c2a9e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:57.917756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48a873-b2bf-4d1e-8bde-56a65b5c2a9e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:57.945108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:57.955800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:57.957186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:57.957476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:57.957757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:57.971912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:57.981446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:57.982390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:57.983728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 74/151] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:32:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:57.988986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c7e4d-0005-43c4-accc-5d88ae82332f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:58.131600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c7e4d-0005-43c4-accc-5d88ae82332f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:58.169683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:58.182473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ff7a3-b640-4a71-abeb-29be7ee6d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:58.183190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ff7a3-b640-4a71-abeb-29be7ee6d399 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.183475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ff7a3-b640-4a71-abeb-29be7ee6d399 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.183760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ff7a3-b640-4a71-abeb-29be7ee6d399 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.184526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ff7a3-b640-4a71-abeb-29be7ee6d399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:58.184843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ff7a3-b640-4a71-abeb-29be7ee6d399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:58.186363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ff7a3-b640-4a71-abeb-29be7ee6d399 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:58.199138 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 78/152] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:32:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:58.204287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:58.315706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384eaf2-9145-44b9-8a14-f95a762d0890 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.316245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384eaf2-9145-44b9-8a14-f95a762d0890 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.316320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384eaf2-9145-44b9-8a14-f95a762d0890 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.317703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 79/153] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:58.323136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0fb3-620c-4f05-8578-b5b1b3339529 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.323437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0fb3-620c-4f05-8578-b5b1b3339529 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.323724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0fb3-620c-4f05-8578-b5b1b3339529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.364323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2d2b0fb3-620c-4f05-8578-b5b1b3339529 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:58.365869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2d2b0fb3-620c-4f05-8578-b5b1b3339529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:58.389058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd63d7-be0f-41e2-bee7-ad04518216ce None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:58.495631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:58.496548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.496835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.497113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.498363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:58.499850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:58.501774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 75/154] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:58 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:58.507602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:58.509777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 80/155] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:58.559530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0fb3-620c-4f05-8578-b5b1b3339529 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:58.593871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:58.686717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df5cc-03d2-4549-a923-a6a46cb2feed None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:58.733196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0fb3-620c-4f05-8578-b5b1b3339529 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:58.769906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514963c-08bb-4a26-8bdf-9b75f2c59cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:58.770516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514963c-08bb-4a26-8bdf-9b75f2c59cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.770852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514963c-08bb-4a26-8bdf-9b75f2c59cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.771163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514963c-08bb-4a26-8bdf-9b75f2c59cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.772158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:58.795626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51ddf1-8fcc-4ade-b7ed-d238be0b81ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:58.796451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ddf1-8fcc-4ade-b7ed-d238be0b81ab None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.796740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ddf1-8fcc-4ade-b7ed-d238be0b81ab None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.797022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ddf1-8fcc-4ade-b7ed-d238be0b81ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.811942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51ddf1-8fcc-4ade-b7ed-d238be0b81ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-3d51ddf1-8fcc-4ade-b7ed-d238be0b81ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:58.820352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:58.821418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:32:58.822657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 81/156] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:32:58.827245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc697-eb71-4f38-b555-b51e4eb93e22 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.827561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc697-eb71-4f38-b555-b51e4eb93e22 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.827855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bc697-eb71-4f38-b555-b51e4eb93e22 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.829474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 82/157] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:58.830624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255c5d-8055-42cf-8aba-d4579c6539d3 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:58.830933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255c5d-8055-42cf-8aba-d4579c6539d3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:58.831220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9255c5d-8055-42cf-8aba-d4579c6539d3 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:58.832613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 83/158] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:32:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:32:58.833914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9255c5d-8055-42cf-8aba-d4579c6539d3 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:58.869870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514963c-08bb-4a26-8bdf-9b75f2c59cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:58.879559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514963c-08bb-4a26-8bdf-9b75f2c59cf3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:58.961932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:59.003712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9255c5d-8055-42cf-8aba-d4579c6539d3 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:59.049561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 76/159] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:32:59.050800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a253b-3add-4100-a6e8-6c2c8d292279 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.051127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a253b-3add-4100-a6e8-6c2c8d292279 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.051398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a253b-3add-4100-a6e8-6c2c8d292279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.059642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119e6f4-fd29-4604-833b-7ae70c0a6b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:59.060510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e6f4-fd29-4604-833b-7ae70c0a6b04 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.060802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e6f4-fd29-4604-833b-7ae70c0a6b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.061088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e6f4-fd29-4604-833b-7ae70c0a6b04 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.061861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119e6f4-fd29-4604-833b-7ae70c0a6b04 None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:59.062175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119e6f4-fd29-4604-833b-7ae70c0a6b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:59.063702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119e6f4-fd29-4604-833b-7ae70c0a6b04 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:59.073897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 84/160] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:59.083297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdffb-0e59-4d46-97e3-39feec509f17 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.083736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdffb-0e59-4d46-97e3-39feec509f17 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.084029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdffb-0e59-4d46-97e3-39feec509f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.087915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-959a253b-3add-4100-a6e8-6c2c8d292279 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:59.089133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-959a253b-3add-4100-a6e8-6c2c8d292279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:59.123968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1f4bdffb-0e59-4d46-97e3-39feec509f17 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:32:59.125182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1f4bdffb-0e59-4d46-97e3-39feec509f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:32:59.193199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:59.213510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 77/161] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:59.214388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a253b-3add-4100-a6e8-6c2c8d292279 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:59.300385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 85/162] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:32:59.301183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bdffb-0e59-4d46-97e3-39feec509f17 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:59.341098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:59.365208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a253b-3add-4100-a6e8-6c2c8d292279 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:59.419602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:59.420487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.420777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.421051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.422260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:59.423742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:59.425444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 78/163] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:32:59 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:59.426206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:59.533133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bdffb-0e59-4d46-97e3-39feec509f17 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:59.593020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:59.593835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.594121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.594398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.600198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:59.601679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:59.603559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 86/164] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:32:59 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:59.604114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:59.613345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c3855-83f3-4dc8-a441-f495ce3ddb11 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:59.656224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:59.678557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:59.679404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.679693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.679972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.697907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:32:59.705808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:32:59.706727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:32:59.707966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 79/165] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:32:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:32:59.709356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:59.727768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:59.823655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93d54-28a5-42c1-a260-7ba929ba6765 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:59.836902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140f6e5-cbfa-47de-8c8f-0df4fcf58f7b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:32:59.862938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:59.863837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.864646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.865094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.866093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] RBAC: Adding query filter params (role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=33de371567f9414098226ad9427441e5, user.id=e717eaf0c527468cbf87f65de0f065e5) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:32:59.866557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:32:59.868357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:32:59.875466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 80/166] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:32:59 2022] GET /identity/v3/role_assignments?user.id=e717eaf0c527468cbf87f65de0f065e5&scope.project.id=33de371567f9414098226ad9427441e5&role.id=c9b4590007f942458d155393f4a0da83 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:32:59.877023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:32:59.970845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:32:59.971103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:32:59.971690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:32:59.971937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:32:59.972289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:32:59.993428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79652439-099c-42b6-85d1-277a4ec0ebf0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.023603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:00.031768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:00.032684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:00.033478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 87/167] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:32:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:00.034222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.037449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.038449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.038995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.039610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.119142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:00.128450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:00.248913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:00.252292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c09f-7766-4a25-a027-18e1a5035bc2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.288264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.289322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.289812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.290294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.291999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:00.292544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:00.294136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:00.295275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:00.304540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 88/168] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:00.305703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.378094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 81/169] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:32:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:00.378883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.427681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503b4c-7666-47f7-b4c6-e77cf47c2c7a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.466219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478568-86e4-4536-a538-ef4c2268a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.467564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478568-86e4-4536-a538-ef4c2268a33d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.468110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478568-86e4-4536-a538-ef4c2268a33d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.468634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478568-86e4-4536-a538-ef4c2268a33d None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.469791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478568-86e4-4536-a538-ef4c2268a33d None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:00.470437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478568-86e4-4536-a538-ef4c2268a33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:00.472089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478568-86e4-4536-a538-ef4c2268a33d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:00.483131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 89/170] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:00.484759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146c13-e20c-46ca-88e2-21f76aca2c9c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.485260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146c13-e20c-46ca-88e2-21f76aca2c9c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.485839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146c13-e20c-46ca-88e2-21f76aca2c9c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.487471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 90/171] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:00.488396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54146c13-e20c-46ca-88e2-21f76aca2c9c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.519290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:00.560884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52217-90ed-44c4-bc19-c61e513d6642 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.601923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54146c13-e20c-46ca-88e2-21f76aca2c9c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.638830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.640187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.640680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.641272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.642680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:00.643596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c623fe-a858-45c5-940a-bf526b277b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.644565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c623fe-a858-45c5-940a-bf526b277b0a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.644857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c623fe-a858-45c5-940a-bf526b277b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.644960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:00.645132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c623fe-a858-45c5-940a-bf526b277b0a None admin] PATH_INFO: `/v3/users/f899d83db9084c5aa9d23df884d32076` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.646380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c623fe-a858-45c5-940a-bf526b277b0a None admin] RBAC: Authorizing `identity:get_user(user_id=f899d83db9084c5aa9d23df884d32076)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:00.647745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 91/172] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:00.647865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c623fe-a858-45c5-940a-bf526b277b0a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:00.648827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.654108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 82/173] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/users/f899d83db9084c5aa9d23df884d32076 => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:00.654108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab66f2-b4e7-427d-9a38-2b1e2f399abd None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.654108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab66f2-b4e7-427d-9a38-2b1e2f399abd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.655283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab66f2-b4e7-427d-9a38-2b1e2f399abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.691936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c8ab66f2-b4e7-427d-9a38-2b1e2f399abd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:00.693225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c8ab66f2-b4e7-427d-9a38-2b1e2f399abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:00.753161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:00.761419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:00.777594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8291f-a10f-457b-8987-667505230ff6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.799868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 83/174] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:00.801295 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab66f2-b4e7-427d-9a38-2b1e2f399abd None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.820163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.821260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.821552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.821836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] PATH_INFO: `/v3/users/e717eaf0c527468cbf87f65de0f065e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.826296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] RBAC: Authorizing `identity:get_user(user_id=e717eaf0c527468cbf87f65de0f065e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:00.829614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:00.831617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 92/175] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/users/e717eaf0c527468cbf87f65de0f065e5 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:00.833258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.923999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab66f2-b4e7-427d-9a38-2b1e2f399abd None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.937980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869b8c-b990-4171-ba2e-8e8e2ac6bb75 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:00.961329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125edca1-e54e-4b10-bf54-150d423598ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.961997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edca1-e54e-4b10-bf54-150d423598ff None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.962284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edca1-e54e-4b10-bf54-150d423598ff None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.962562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edca1-e54e-4b10-bf54-150d423598ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.963434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edca1-e54e-4b10-bf54-150d423598ff None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=33de371567f9414098226ad9427441e5, user.id=e717eaf0c527468cbf87f65de0f065e5) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:00.963773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edca1-e54e-4b10-bf54-150d423598ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:00.965192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edca1-e54e-4b10-bf54-150d423598ff None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:00.971229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 84/176] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/role_assignments?user.id=e717eaf0c527468cbf87f65de0f065e5&scope.project.id=33de371567f9414098226ad9427441e5&role.id=a73d3b84962843cdb2898ec86046e88e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:00.972280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f207-b6b2-45ec-8eb4-fc39b7957830 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.972570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f207-b6b2-45ec-8eb4-fc39b7957830 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.972845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f207-b6b2-45ec-8eb4-fc39b7957830 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:00.979012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 85/177] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:00.979012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614f207-b6b2-45ec-8eb4-fc39b7957830 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:00.983784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13a31d-d960-4bbf-bda1-f4f619e6acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:00.984903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13a31d-d960-4bbf-bda1-f4f619e6acea None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:00.985457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13a31d-d960-4bbf-bda1-f4f619e6acea None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:00.986039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13a31d-d960-4bbf-bda1-f4f619e6acea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.015616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.016938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.068141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13a31d-d960-4bbf-bda1-f4f619e6acea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:01.069727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13a31d-d960-4bbf-bda1-f4f619e6acea None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:01.104470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614f207-b6b2-45ec-8eb4-fc39b7957830 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.144784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.146459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.146956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.147408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.159118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:01.167528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:01.168427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:01.169238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 86/178] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:01.169897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.200160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 93/179] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:01.201557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf73389-711f-4867-aa51-50f039d211fd None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.201796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf73389-711f-4867-aa51-50f039d211fd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.202144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf73389-711f-4867-aa51-50f039d211fd None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.203617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 94/180] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:01.204601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccdd40-140b-43b9-87f8-2805fad89d64 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.204888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccdd40-140b-43b9-87f8-2805fad89d64 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.205295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccdd40-140b-43b9-87f8-2805fad89d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.223506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-bcccdd40-140b-43b9-87f8-2805fad89d64 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:01.226977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bcccdd40-140b-43b9-87f8-2805fad89d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:01.272022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.275267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.278692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd014b0-7c0e-49e4-953e-b41111dfb5e9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.293258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 95/181] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:01.294548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ef1e-83a1-4955-b001-c31df30e2b64 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.294836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ef1e-83a1-4955-b001-c31df30e2b64 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.295153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ef1e-83a1-4955-b001-c31df30e2b64 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.296571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 96/182] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:01.297100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1ef1e-83a1-4955-b001-c31df30e2b64 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.317146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.317848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.318135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.318414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.385630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:01.387137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:01.396661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1ef1e-83a1-4955-b001-c31df30e2b64 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.429881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095881f-6eb7-467c-a287-5bd6a7fe4aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.430550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095881f-6eb7-467c-a287-5bd6a7fe4aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.430833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095881f-6eb7-467c-a287-5bd6a7fe4aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.431148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095881f-6eb7-467c-a287-5bd6a7fe4aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.431897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095881f-6eb7-467c-a287-5bd6a7fe4aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:01.432205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095881f-6eb7-467c-a287-5bd6a7fe4aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:01.433592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095881f-6eb7-467c-a287-5bd6a7fe4aa6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:01.441783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 97/183] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:01.443681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20d83-fb9d-4190-a57d-a558d73723cf None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.443908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20d83-fb9d-4190-a57d-a558d73723cf None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.444161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20d83-fb9d-4190-a57d-a558d73723cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.460365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b8c20d83-fb9d-4190-a57d-a558d73723cf None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:01.461472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b8c20d83-fb9d-4190-a57d-a558d73723cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:01.482399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.489452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 87/184] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:01.489452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.503090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.528039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 98/185] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:01.529306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06cc9-9ca0-468a-89ea-b6d692c08d06 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.529602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06cc9-9ca0-468a-89ea-b6d692c08d06 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.529889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f06cc9-9ca0-468a-89ea-b6d692c08d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.545587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-65f06cc9-9ca0-468a-89ea-b6d692c08d06 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:01.546763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-65f06cc9-9ca0-468a-89ea-b6d692c08d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:01.589985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd714e3-024b-49db-ba45-596a0d01257c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.611346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 99/186] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:01.612283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06cc9-9ca0-468a-89ea-b6d692c08d06 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.625223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.626112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.626405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.626691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.627924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:01.629383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:01.636341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 88/187] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:01.636341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.694765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.719257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f06cc9-9ca0-468a-89ea-b6d692c08d06 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.726466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.735961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ee625-7575-4ffb-9a03-ba0eee0f86c9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.754812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.756228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.756514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.756786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.766662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:01.769274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.770157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.770444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.770721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] PATH_INFO: `/v3/users/d799f2e4420644cead1a8b3bd804ada6` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:01.774411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:01.775613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 100/188] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:01.781567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.790402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=d799f2e4420644cead1a8b3bd804ada6)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:01.791880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:01.793559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 89/189] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/users/d799f2e4420644cead1a8b3bd804ada6 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:01.794323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.880884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b3d8-7599-4777-885b-8ae85b1fced7 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.890314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c4fe-5407-4a47-ac3d-93adf5a97cb9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:01.912751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.913053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:01.913615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.913903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.914230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] PATH_INFO: `/v3/projects/4e6a2b2459fd41afb35386213c30be51` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.915686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6a2b2459fd41afb35386213c30be51)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:01.917159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:01.918835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 101/190] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/projects/4e6a2b2459fd41afb35386213c30be51 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:01.923968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.924639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:01.925456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:01.925749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:01.926030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:01.936487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:01.945252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:01.946145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:01.946952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 90/191] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:01.947617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:01.962909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.027314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158025-b041-4fba-bf27-356ea6d55c51 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.045369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae709d7-e4ce-418c-a6e7-7b0bf0bf183d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.061347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.062154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.062441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.062721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.063916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.065371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.071280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 102/192] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.071280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.077930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.078590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.078878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.079189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.080035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=33de371567f9414098226ad9427441e5, user.id=f899d83db9084c5aa9d23df884d32076) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:02.080351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.081790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.087954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 91/193] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:01 2022] GET /identity/v3/role_assignments?user.id=f899d83db9084c5aa9d23df884d32076&scope.project.id=33de371567f9414098226ad9427441e5&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.088722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.151128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.177356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a2baf-d9e7-4b92-909b-d3563c8aff5b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.180050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.213607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996f2a5-f66a-4f64-a823-15f6d03d3230 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.219170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.219865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.220149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.220426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.221491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:02.221491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.222908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.232542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 103/194] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.233336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.259359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.260030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.260319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.260602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.354584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.356830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.368984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973face5-8e9e-498c-8bc1-33b25355245d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.404127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.404798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.405091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.406459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.406569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.406684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=4e6a2b2459fd41afb35386213c30be51, user.id=e717eaf0c527468cbf87f65de0f065e5) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:02.406801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.408717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.427246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 104/195] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/role_assignments?user.id=e717eaf0c527468cbf87f65de0f065e5&scope.project.id=4e6a2b2459fd41afb35386213c30be51&role.id=a73d3b84962843cdb2898ec86046e88e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.427246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.449438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.495873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 92/196] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:02.501523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.533945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27215711-e5f7-4fce-9687-469e13ea90f3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.580204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.581010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.581183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.581470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.582248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:02.582567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.584813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.593489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 105/197] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.599864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.639333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11cee-0248-45db-9a89-8256c6f118a3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.680733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.681428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.681719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.682246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.683023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.684501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.706719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 93/198] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:02 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:02.707611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.710277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.720353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.733393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8badcb4-765d-4abe-8c84-f38bf71eccd2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.776168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.777945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.778446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.779007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] PATH_INFO: `/v3/users/e23a9d2b02be4431992c3a875ac566ba` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.781369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] RBAC: Authorizing `identity:get_user(user_id=e23a9d2b02be4431992c3a875ac566ba)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.783559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.786386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 106/199] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/users/e23a9d2b02be4431992c3a875ac566ba => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.787902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.835789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5318e0-0d6a-4eed-9821-74457105154e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.880789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.881678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.881964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.882251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.883678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.884986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.886796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 94/200] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.887486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.907620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a0da2-c3bf-4818-b622-f9845472fca2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:02.954100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:02.955447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:02.956349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:02.956349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] PATH_INFO: `/v3/users/d799f2e4420644cead1a8b3bd804ada6` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:02.957297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] RBAC: Authorizing `identity:get_user(user_id=d799f2e4420644cead1a8b3bd804ada6)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:02.958861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:02.961709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 107/201] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/users/d799f2e4420644cead1a8b3bd804ada6 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:02.962564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:02.969177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:02.998997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:03.007541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d10be9-0754-46aa-8f1a-cf5e2a71f0df None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:03.046533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:03.047331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:03.047587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:03.047789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:03.089076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3902dd-d8cb-4154-aa40-0cc9bcb31646 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:03.125724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:03.126507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:03.126806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:03.127140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:03.127994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=d799f2e4420644cead1a8b3bd804ada6) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:03.128317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:03.129780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:03.135086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:03.135987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 108/202] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/role_assignments?user.id=d799f2e4420644cead1a8b3bd804ada6&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:03.136645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:03.137584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:03.250938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:03.303331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:03.327329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 95/203] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:03.328158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a53ff-5dad-4eaa-a496-4fdd9bd01875 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:03.332500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:03.387395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:03.388060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:03.388349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:03.388734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:03.480162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afcc74-3daa-4503-8bea-aad65d5bc434 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:03.519097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:03.520502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:03.542087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:03.543048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:03.543335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:03.543615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:03.545486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:03.546982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:03.551230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 96/204] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:03 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:03.555814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:03.628666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:03.691283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:03.703936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 109/205] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:03.711689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:03.738900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f0efb-455f-46c7-af7e-2a5880e20996 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:03.797636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:03.798228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:03.798520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:03.798802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:03.799678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] RBAC: Adding query filter params (role.id=118a743b3fb844bf8f61de225e3365b2, scope.project.id=33de371567f9414098226ad9427441e5, user.id=e23a9d2b02be4431992c3a875ac566ba) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:03.799997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:03.801444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:03.820016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 97/206] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:03 2022] GET /identity/v3/role_assignments?user.id=e23a9d2b02be4431992c3a875ac566ba&scope.project.id=33de371567f9414098226ad9427441e5&role.id=118a743b3fb844bf8f61de225e3365b2 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:03.870994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a632a-ae1a-44a0-9bef-c78e081bfb6c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:03.908074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a05b2-fcef-4ac2-a392-988a98f8803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:03.908991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a05b2-fcef-4ac2-a392-988a98f8803a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:03.909422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a05b2-fcef-4ac2-a392-988a98f8803a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:03.909702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a05b2-fcef-4ac2-a392-988a98f8803a None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:03.911069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a05b2-fcef-4ac2-a392-988a98f8803a None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:03.912602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a05b2-fcef-4ac2-a392-988a98f8803a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:03.914372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 110/207] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:03 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:03.920411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:04.058498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27954-b2a1-4fad-9025-3c5e37dfbbd2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:04.060021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:04.096747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e237-af48-4087-afba-c89a922c7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:04.097475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e237-af48-4087-afba-c89a922c7e23 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:04.097763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e237-af48-4087-afba-c89a922c7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:04.098045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e237-af48-4087-afba-c89a922c7e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:04.098994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e237-af48-4087-afba-c89a922c7e23 None admin] RBAC: Adding query filter params (role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=d799f2e4420644cead1a8b3bd804ada6) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:04.099313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e237-af48-4087-afba-c89a922c7e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:04.100753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e237-af48-4087-afba-c89a922c7e23 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:04.111092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 98/208] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:03 2022] GET /identity/v3/role_assignments?user.id=d799f2e4420644cead1a8b3bd804ada6&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=c9b4590007f942458d155393f4a0da83 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:04.950435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750abf-1d8c-4d66-b6b9-3e9f3e405cec None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:04.951444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750abf-1d8c-4d66-b6b9-3e9f3e405cec None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:04.951979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750abf-1d8c-4d66-b6b9-3e9f3e405cec None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:04.953793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 111/209] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:04.959939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4932f9-f0ae-4f85-a99e-df29e328bfa8 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:04.960474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4932f9-f0ae-4f85-a99e-df29e328bfa8 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:04.960948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4932f9-f0ae-4f85-a99e-df29e328bfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:04.978631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2d4932f9-f0ae-4f85-a99e-df29e328bfa8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:04.980111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2d4932f9-f0ae-4f85-a99e-df29e328bfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:05.053799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 99/210] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:05.078441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750abf-1d8c-4d66-b6b9-3e9f3e405cec None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.140791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:05.184589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750abf-1d8c-4d66-b6b9-3e9f3e405cec None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:05.220015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11006752-43f4-4814-a3a7-e29486a5d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:05.220833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11006752-43f4-4814-a3a7-e29486a5d3ef None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.221118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11006752-43f4-4814-a3a7-e29486a5d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.221391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11006752-43f4-4814-a3a7-e29486a5d3ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.222553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11006752-43f4-4814-a3a7-e29486a5d3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:05.224086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11006752-43f4-4814-a3a7-e29486a5d3ef None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:05.226087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 112/211] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:05.231642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4932f9-f0ae-4f85-a99e-df29e328bfa8 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.244071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af507-459c-4930-834a-cda5f0d4f605 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.244369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af507-459c-4930-834a-cda5f0d4f605 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.244657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af507-459c-4930-834a-cda5f0d4f605 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.246855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 113/212] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:33:05.252921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa749723-5dae-49ce-8b65-3b81d8df7670 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.253210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa749723-5dae-49ce-8b65-3b81d8df7670 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.253504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa749723-5dae-49ce-8b65-3b81d8df7670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.277303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fa749723-5dae-49ce-8b65-3b81d8df7670 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:05.278517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fa749723-5dae-49ce-8b65-3b81d8df7670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:05.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:05.352095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4932f9-f0ae-4f85-a99e-df29e328bfa8 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:05.354868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 114/213] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:05.371405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeee8d0-12a8-411d-83f5-577f2b307f0a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.371699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeee8d0-12a8-411d-83f5-577f2b307f0a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.371982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeee8d0-12a8-411d-83f5-577f2b307f0a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.373591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 115/214] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:33:05.378507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb314df0-c829-4cfc-859c-2bebeb6b196d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.378802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb314df0-c829-4cfc-859c-2bebeb6b196d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.379124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb314df0-c829-4cfc-859c-2bebeb6b196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.391592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:05.392373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.392617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.392848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.393580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:05.395084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:05.396801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-bb314df0-c829-4cfc-859c-2bebeb6b196d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:05.397969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bb314df0-c829-4cfc-859c-2bebeb6b196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:05.418085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 100/215] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:05 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:05.418709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.462651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:05.489043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 116/216] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:05.508677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb314df0-c829-4cfc-859c-2bebeb6b196d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.534760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce9084-feea-4ecd-a9f8-72e114040356 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:05.573578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:05.574744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.575249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.575701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.590805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:05.604713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:05.605606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:05.606396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:05.608293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 101/217] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:05.613956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.631601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:05.634284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb314df0-c829-4cfc-859c-2bebeb6b196d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:05.674754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:05.676547 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.677357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.677635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.693903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:05.703231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:05.704153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:05.705263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 117/218] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:05.711395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.749060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0effbf-beb2-4b64-96c3-eb12e0cb3cf9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:05.768940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:05.798797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:05.799823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.800265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.800549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.801312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:05.801625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:05.803594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:05.815035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 102/219] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:05.819557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.834489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade8788-3064-43cd-a622-a7e272f54e27 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:05.876156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:05.876879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.877168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.877451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:05.878318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:05.878641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:05.880124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:05.893716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 118/220] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:05.895285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:05.918230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:05.946635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70852e45-97e4-4bfa-9680-cd0e29a125bd None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:05.994973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:05.996513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:05.997142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:05.997530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] PATH_INFO: `/v3/users/c3921e8a41a84ac1883ea2191074892a` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.015754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de500-b426-4971-acb3-1766276f7ccb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:06.016247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] RBAC: Authorizing `identity:get_user(user_id=c3921e8a41a84ac1883ea2191074892a)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:06.017594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:06.020913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 103/221] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:05 2022] GET /identity/v3/users/c3921e8a41a84ac1883ea2191074892a => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:06.029381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:06.030549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:06.074884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:06.076050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.076487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.076943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] PATH_INFO: `/v3/users/d799f2e4420644cead1a8b3bd804ada6` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.083709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] RBAC: Authorizing `identity:get_user(user_id=d799f2e4420644cead1a8b3bd804ada6)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:06.085356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:06.087231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 119/222] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:05 2022] GET /identity/v3/users/d799f2e4420644cead1a8b3bd804ada6 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:06.094233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:06.143570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18fb7-7e83-4e43-99b8-fe4df5f91bfb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:06.187774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:06.207657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36d986-0e18-4272-9844-098925c37dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:06.208901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d986-0e18-4272-9844-098925c37dac None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.209196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d986-0e18-4272-9844-098925c37dac None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.209477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d986-0e18-4272-9844-098925c37dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.231304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be293dd-1436-45f5-ad2f-9ecbb9f0e1d6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:06.268105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:06.269710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.269998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.270554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.273630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:06.276061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:06.280155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 120/223] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:06 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:06.284602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:06.328822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36d986-0e18-4272-9844-098925c37dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:06.331044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36d986-0e18-4272-9844-098925c37dac None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:06.335606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:06.393601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a036-0807-4066-a9c2-902f55c5ade5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:06.429400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e6d8-dd55-48ad-8a51-e300065726a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:06.430348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e6d8-dd55-48ad-8a51-e300065726a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.430683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e6d8-dd55-48ad-8a51-e300065726a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.430994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e6d8-dd55-48ad-8a51-e300065726a2 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/d799f2e4420644cead1a8b3bd804ada6/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.433180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4e6d8-dd55-48ad-8a51-e300065726a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e156cfe62c864df8a73d802d59ef75a3, user_id=d799f2e4420644cead1a8b3bd804ada6, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:06.434695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4e6d8-dd55-48ad-8a51-e300065726a2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:06.458638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 121/225] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:06 2022] PUT /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/d799f2e4420644cead1a8b3bd804ada6/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:06.458638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30767a-94d8-4bd4-ab16-a2b4f379849c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.458638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30767a-94d8-4bd4-ab16-a2b4f379849c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.458638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30767a-94d8-4bd4-ab16-a2b4f379849c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.459364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 122/226] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:06.459640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 104/226] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:06.461092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30767a-94d8-4bd4-ab16-a2b4f379849c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:06.464918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cff92-eb32-4691-b27d-676e7b83a4c6 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.465262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cff92-eb32-4691-b27d-676e7b83a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.465606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cff92-eb32-4691-b27d-676e7b83a4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.491065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-251cff92-eb32-4691-b27d-676e7b83a4c6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:06.492636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-251cff92-eb32-4691-b27d-676e7b83a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:06.532640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:06.582480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30767a-94d8-4bd4-ab16-a2b4f379849c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:06.586210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:06.590487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 105/227] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:06.625983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cff92-eb32-4691-b27d-676e7b83a4c6 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:06.626173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:06.627372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.627962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.628462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.631218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:06.632958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:06.634939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 123/228] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:06 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:06.653475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:06.787150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cff92-eb32-4691-b27d-676e7b83a4c6 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:06.792071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7a09-b4ac-4fae-8154-d8a8a1d47767 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:06.825113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:06.826277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.826759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.826898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:06.827430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.827532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:06.827764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:06.828052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:06.829100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=c3921e8a41a84ac1883ea2191074892a) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:06.829419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:06.830893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:06.843314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 124/229] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:06 2022] GET /identity/v3/role_assignments?user.id=c3921e8a41a84ac1883ea2191074892a&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=a73d3b84962843cdb2898ec86046e88e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:06.847604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:06.856448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:06.857314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:06.858124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:06.865623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 106/230] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:06.866900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:06.924326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:07.003010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1e75f-cd4d-4069-a705-e840e3b6c9fa None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:07.039152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:07.039748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:07.040043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:07.040329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:07.041102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:07.041422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:07.042822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:07.052937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 125/231] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:07.058138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:07.090586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:07.184388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98779a-9884-4624-807e-b8b10f827fd5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:07.227339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:07.228614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:07.229123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:07.229596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] PATH_INFO: `/v3/users/d799f2e4420644cead1a8b3bd804ada6` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:07.231044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] RBAC: Authorizing `identity:get_user(user_id=d799f2e4420644cead1a8b3bd804ada6)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:07.232687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:07.234510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 107/232] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:07 2022] GET /identity/v3/users/d799f2e4420644cead1a8b3bd804ada6 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:07.240578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:07.373593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:07.383361 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a368fe1-5c1f-4c16-b087-736573f0187f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:07.426952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92da2-2d9b-479e-8596-da6296d910e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:07.427845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92da2-2d9b-479e-8596-da6296d910e1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:07.428132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92da2-2d9b-479e-8596-da6296d910e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:07.428415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92da2-2d9b-479e-8596-da6296d910e1 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:07.429606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb92da2-2d9b-479e-8596-da6296d910e1 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:07.431099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb92da2-2d9b-479e-8596-da6296d910e1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:07.433104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 126/233] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:07 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:07.438428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:07.546442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:07.565697 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdff38-e1af-47c6-980e-9291486bcad7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:07.601925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb93bb-e38f-4d88-8317-38157ff98861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:07.602832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb93bb-e38f-4d88-8317-38157ff98861 None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:07.603147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb93bb-e38f-4d88-8317-38157ff98861 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:07.603425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb93bb-e38f-4d88-8317-38157ff98861 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/d799f2e4420644cead1a8b3bd804ada6/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:07.605702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb93bb-e38f-4d88-8317-38157ff98861 None admin] RBAC: Authorizing `identity:create_grant(project_id=e156cfe62c864df8a73d802d59ef75a3, user_id=d799f2e4420644cead1a8b3bd804ada6, role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:07.607218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb93bb-e38f-4d88-8317-38157ff98861 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:07.622666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 108/234] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:07 2022] PUT /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/d799f2e4420644cead1a8b3bd804ada6/roles/c9b4590007f942458d155393f4a0da83 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:08.139284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c83c-7c79-4fca-859c-bf5543bca306 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.139829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c83c-7c79-4fca-859c-bf5543bca306 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.139829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c83c-7c79-4fca-859c-bf5543bca306 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.141497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 127/235] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:08.152204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd6728-2988-4365-a045-34651954d33b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.152741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd6728-2988-4365-a045-34651954d33b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.153243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd6728-2988-4365-a045-34651954d33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.174648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-32fd6728-2988-4365-a045-34651954d33b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:08.176183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-32fd6728-2988-4365-a045-34651954d33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:08.227224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3669-c91b-48b9-aa65-52249c635199 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.227527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3669-c91b-48b9-aa65-52249c635199 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.227806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3669-c91b-48b9-aa65-52249c635199 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.229416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 128/236] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:08.234463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71277-7c10-426d-aa32-e64ddc27d43d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.234758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71277-7c10-426d-aa32-e64ddc27d43d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.235108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71277-7c10-426d-aa32-e64ddc27d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.265640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 109/237] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:08.266830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4fc71277-7c10-426d-aa32-e64ddc27d43d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:08.268209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4fc71277-7c10-426d-aa32-e64ddc27d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:08.307513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd6728-2988-4365-a045-34651954d33b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:08.337762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 129/238] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:08.363427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71277-7c10-426d-aa32-e64ddc27d43d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:08.418467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:08.469046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd6728-2988-4365-a045-34651954d33b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:08.475526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:08.484516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71277-7c10-426d-aa32-e64ddc27d43d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:08.523497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:08.525050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.525618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.526041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.539142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:08.547468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:08.548527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:08.549533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:08.551945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 130/239] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:08.555596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:08.556486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.556698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.556977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.557764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:08.558212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:08.559667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:08.561531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 110/240] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:08.566636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:08.736111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd339e0-4c6c-4dc3-a161-1b6ae991bd5e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:08.753303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dff180-e120-4dcc-9778-f7135456a957 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:08.804111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:08.804796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.805079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.805360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.806120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:08.806428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:08.810601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:08.821215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557db909-440d-4832-8868-3c595ad38112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:08.821903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557db909-440d-4832-8868-3c595ad38112 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:08.822191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557db909-440d-4832-8868-3c595ad38112 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:08.822469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557db909-440d-4832-8868-3c595ad38112 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:08.823213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557db909-440d-4832-8868-3c595ad38112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:08.825967 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557db909-440d-4832-8868-3c595ad38112 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:08.829172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 131/241] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:08.834843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:08.859260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:08.870696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 111/242] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:08 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:33:08.989331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b71656-48d6-4025-9421-ab416e82e04d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:09.047088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f449e7-acd9-49aa-8935-c2fa91cf3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:09.048053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f449e7-acd9-49aa-8935-c2fa91cf3d53 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.048342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f449e7-acd9-49aa-8935-c2fa91cf3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.048620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f449e7-acd9-49aa-8935-c2fa91cf3d53 None admin] PATH_INFO: `/v3/users/33992df7b47248e59dc917fa28783437` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.066268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f449e7-acd9-49aa-8935-c2fa91cf3d53 None admin] RBAC: Authorizing `identity:get_user(user_id=33992df7b47248e59dc917fa28783437)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:09.068342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f449e7-acd9-49aa-8935-c2fa91cf3d53 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:09.070385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 132/243] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:08 2022] GET /identity/v3/users/33992df7b47248e59dc917fa28783437 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:09.076054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557db909-440d-4832-8868-3c595ad38112 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:09.081643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:09.152062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a942-4acf-44df-be5c-9aa01f9e82db None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.153575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a942-4acf-44df-be5c-9aa01f9e82db None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.154187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a942-4acf-44df-be5c-9aa01f9e82db None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.156587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 133/244] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:09.166436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc5ee-0c42-4174-84a9-89e724017f90 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.166720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc5ee-0c42-4174-84a9-89e724017f90 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.167060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc5ee-0c42-4174-84a9-89e724017f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.189088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ea4bc5ee-0c42-4174-84a9-89e724017f90 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:09.190349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ea4bc5ee-0c42-4174-84a9-89e724017f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:09.218954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557db909-440d-4832-8868-3c595ad38112 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:09.262740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5757468-164c-4009-9f09-8b18ecbcb97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:09.263995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5757468-164c-4009-9f09-8b18ecbcb97c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.264466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5757468-164c-4009-9f09-8b18ecbcb97c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.264911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5757468-164c-4009-9f09-8b18ecbcb97c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.290948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 134/245] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:09.313521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc5ee-0c42-4174-84a9-89e724017f90 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:09.339317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:09.367182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5757468-164c-4009-9f09-8b18ecbcb97c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:09.369180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5757468-164c-4009-9f09-8b18ecbcb97c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:09.373829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:09.476920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc5ee-0c42-4174-84a9-89e724017f90 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:09.513220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 112/246] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:09.515269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1aa9-88f4-47fb-8909-30454e6f1159 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.515771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1aa9-88f4-47fb-8909-30454e6f1159 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.516248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac1aa9-88f4-47fb-8909-30454e6f1159 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.517751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 113/247] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:09.518950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac1aa9-88f4-47fb-8909-30454e6f1159 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:09.522677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62230d2-8edc-4e23-a0d6-fe41bea6175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:09.523522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62230d2-8edc-4e23-a0d6-fe41bea6175c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.523813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62230d2-8edc-4e23-a0d6-fe41bea6175c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.524098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62230d2-8edc-4e23-a0d6-fe41bea6175c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.539181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62230d2-8edc-4e23-a0d6-fe41bea6175c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a62230d2-8edc-4e23-a0d6-fe41bea6175c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:09.548080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:09.549160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 135/248] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:09.549999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efaa70-7730-4077-9606-ce9478b6414e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.549999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efaa70-7730-4077-9606-ce9478b6414e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.550541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efaa70-7730-4077-9606-ce9478b6414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.570336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-80efaa70-7730-4077-9606-ce9478b6414e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:09.571657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-80efaa70-7730-4077-9606-ce9478b6414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:09.652056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:09.666282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 136/249] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:09.667231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efaa70-7730-4077-9606-ce9478b6414e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:09.669199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac1aa9-88f4-47fb-8909-30454e6f1159 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:09.679257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:09.758975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:09.759919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.760199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.760525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.762849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:09.764463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:09.768700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 114/250] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:09 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:09.769539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:09.880188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efaa70-7730-4077-9606-ce9478b6414e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:09.916460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57ea0-9725-4cb7-bd54-99f176dbf060 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:09.950847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:09.951575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.951870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.952158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.952986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:09.953306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:09.953851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:09.954704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:09.954813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:09.955091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:09.955375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:09.966904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:09.975055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 137/251] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:09.975777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:09.976682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:09.977496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:09.978117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:09.978186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 115/252] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:09.981713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:10.044586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:10.058866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:10.120337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af2ce-18fa-461a-b84f-821c09a41a22 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:10.179166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:10.179933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:10.180144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:10.180382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:10.181224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] RBAC: Adding query filter params (role.id=118a743b3fb844bf8f61de225e3365b2, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=33992df7b47248e59dc917fa28783437) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:10.181536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:10.183663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:10.187167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b0df7-0d61-4fac-a3bd-ee3ce1c6c9c1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:10.192133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 138/253] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:09 2022] GET /identity/v3/role_assignments?user.id=33992df7b47248e59dc917fa28783437&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=118a743b3fb844bf8f61de225e3365b2 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:10.193057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:10.262431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986420b-d40a-480e-8479-79855a9b75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:10.263372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986420b-d40a-480e-8479-79855a9b75ed None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:10.263710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986420b-d40a-480e-8479-79855a9b75ed None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:10.264043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986420b-d40a-480e-8479-79855a9b75ed None admin] PATH_INFO: `/v3/users/d799f2e4420644cead1a8b3bd804ada6` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:10.266430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986420b-d40a-480e-8479-79855a9b75ed None admin] RBAC: Authorizing `identity:get_user(user_id=d799f2e4420644cead1a8b3bd804ada6)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:10.271916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986420b-d40a-480e-8479-79855a9b75ed None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:10.278723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 116/254] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:09 2022] GET /identity/v3/users/d799f2e4420644cead1a8b3bd804ada6 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:10.280029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff3f1-1921-4a91-bb82-1d4404201829 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:10.280322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff3f1-1921-4a91-bb82-1d4404201829 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:10.280608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff3f1-1921-4a91-bb82-1d4404201829 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:10.289480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 117/255] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:10.290478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ff3f1-1921-4a91-bb82-1d4404201829 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:10.400020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256c77-b3cd-4a93-95fa-7590859c65e5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:10.423938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:10.455648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e1ad6-5e3c-4d36-ac90-46a4d3b1834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:10.456307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1ad6-5e3c-4d36-ac90-46a4d3b1834d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:10.456592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1ad6-5e3c-4d36-ac90-46a4d3b1834d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:10.456878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1ad6-5e3c-4d36-ac90-46a4d3b1834d None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:10.457635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e1ad6-5e3c-4d36-ac90-46a4d3b1834d None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:10.458563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e1ad6-5e3c-4d36-ac90-46a4d3b1834d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:10.462967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e1ad6-5e3c-4d36-ac90-46a4d3b1834d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:10.468890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 139/256] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:10.470116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff522f1b-ccc6-4bf7-9f01-693c3620f20c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:10.470409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff522f1b-ccc6-4bf7-9f01-693c3620f20c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:10.478977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff522f1b-ccc6-4bf7-9f01-693c3620f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:10.479125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:10.490440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ff3f1-1921-4a91-bb82-1d4404201829 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:10.509692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ff522f1b-ccc6-4bf7-9f01-693c3620f20c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:10.513520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ff522f1b-ccc6-4bf7-9f01-693c3620f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:10.559186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:10.560457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:10.561624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:10.562089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:10.645448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 140/257] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:10.648961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff522f1b-ccc6-4bf7-9f01-693c3620f20c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:10.719916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:10.721647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:10.887247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:10.887712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff522f1b-ccc6-4bf7-9f01-693c3620f20c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:10.890152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 118/258] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:10.890823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:10.928185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:10.997957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:10.998852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:10.999159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:10.999436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] PATH_INFO: `/v3/users/c3921e8a41a84ac1883ea2191074892a` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.005658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=c3921e8a41a84ac1883ea2191074892a)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:11.007156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:11.009053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d515-92df-405d-8263-c18eb7d4d140 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.023334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 141/259] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:10 2022] GET /identity/v3/users/c3921e8a41a84ac1883ea2191074892a => generated 297 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:11.024392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:11.052353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.053184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.053470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.053749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.064881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:11.074386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:11.075485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:11.076450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 119/260] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:11.077221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:11.146437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:11.185165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32cad-6207-4fb1-9136-2decea66b0da None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.220474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.221367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.221659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.221942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.223155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:11.225343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:11.231042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 120/261] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:11 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:11.232938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:11.344199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bafc1-04fd-4540-8028-aa2a99600a43 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.352852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21639e27-c7a1-448c-8a80-a59702665bd9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.377522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:11.383532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.384427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.384919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.385342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.386249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:11.386720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:11.388722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:11.403760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 121/262] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:11.404778 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:11.452732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.453898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.455468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.455900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.459243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:11.461519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:11.465451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 142/263] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:11 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:11.467800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:11.567351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:11.620881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd7fd9-e27a-4d4f-a6e3-631b9c054976 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.630265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ea44c-2e5f-4335-9db4-b9eca552f83c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.666714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe90840-871f-4688-95c7-59817679901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.667626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe90840-871f-4688-95c7-59817679901c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.667913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe90840-871f-4688-95c7-59817679901c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe90840-871f-4688-95c7-59817679901c None admin] PATH_INFO: `/v3/users/d799f2e4420644cead1a8b3bd804ada6` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.669393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe90840-871f-4688-95c7-59817679901c None admin] RBAC: Authorizing `identity:get_user(user_id=d799f2e4420644cead1a8b3bd804ada6)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:11.670848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe90840-871f-4688-95c7-59817679901c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:11.672521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 143/264] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:11 2022] GET /identity/v3/users/d799f2e4420644cead1a8b3bd804ada6 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:11.673358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe90840-871f-4688-95c7-59817679901c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:11.712207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.713215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.713516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.713801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/c3921e8a41a84ac1883ea2191074892a/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.716296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] RBAC: Authorizing `identity:create_grant(project_id=e156cfe62c864df8a73d802d59ef75a3, user_id=c3921e8a41a84ac1883ea2191074892a, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:11.717321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:11.740039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 122/265] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:11 2022] PUT /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/c3921e8a41a84ac1883ea2191074892a/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:11.740723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:11.812049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:11.825790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe90840-871f-4688-95c7-59817679901c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.850696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:11.875270 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2ef42-7047-4173-8226-a9a5258cd4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.875865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ef42-7047-4173-8226-a9a5258cd4d9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.876316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ef42-7047-4173-8226-a9a5258cd4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.876603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2ef42-7047-4173-8226-a9a5258cd4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.878248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2ef42-7047-4173-8226-a9a5258cd4d9 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=d799f2e4420644cead1a8b3bd804ada6) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:11.878568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2ef42-7047-4173-8226-a9a5258cd4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:11.881191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2ef42-7047-4173-8226-a9a5258cd4d9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:11.883705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057cf4d-1f47-45e3-897c-1b4751897818 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:11.889396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 144/266] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:11 2022] GET /identity/v3/role_assignments?user.id=d799f2e4420644cead1a8b3bd804ada6&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:11.890852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a0b9-bf4a-4fc3-b7dc-935d025ac864 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.891208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a0b9-bf4a-4fc3-b7dc-935d025ac864 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.891492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a0b9-bf4a-4fc3-b7dc-935d025ac864 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.893091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 145/267] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:11.894333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e270-dab9-4408-9358-de9b07ee62c6 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.894629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e270-dab9-4408-9358-de9b07ee62c6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.894924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e270-dab9-4408-9358-de9b07ee62c6 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.898111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 146/268] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:11.899505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98ad3e-78a1-43f9-8a95-23d075751bb6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.899799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98ad3e-78a1-43f9-8a95-23d075751bb6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.900080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98ad3e-78a1-43f9-8a95-23d075751bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:11.924369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0d98ad3e-78a1-43f9-8a95-23d075751bb6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:11.926878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0d98ad3e-78a1-43f9-8a95-23d075751bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:11.938355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:11.939131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:11.939428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:11.939763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.008095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 147/269] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:12.010503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b310eb-4056-42db-a656-bc6e461736a9 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.011343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b310eb-4056-42db-a656-bc6e461736a9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.011830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b310eb-4056-42db-a656-bc6e461736a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.025305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:12.026831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:12.050204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f9b310eb-4056-42db-a656-bc6e461736a9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:12.051506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f9b310eb-4056-42db-a656-bc6e461736a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:12.127398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:12.152584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 148/270] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:12.153467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b310eb-4056-42db-a656-bc6e461736a9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.172278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 123/271] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:12.180563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.215766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:12.276521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b310eb-4056-42db-a656-bc6e461736a9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.301183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc64d0-f2d5-4573-8ce0-17d4103169f3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.315419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.316237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.316525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.316808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.318546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:12.320031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:12.321669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 149/272] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:12.322436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.341073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.341963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.342292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.342533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.343791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:12.345300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:12.349096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 124/273] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:12.349890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.387373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:12.424991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4916a-dcdd-4fe9-8869-386ed6d38857 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.436602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:12.461767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90054a-96f4-4374-a3c1-527cf3379887 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.462411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.463345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.463699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.464049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.475010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:12.483296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:12.484351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:12.485302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:12.485912 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 150/274] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:12.486521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.502271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.503085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.503375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.503656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.504477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:12.506507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:12.532115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 125/275] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:12 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:12.533645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.606504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41427a2-c07c-4d40-9465-be6174aaaa59 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.635305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:12.660250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1def42-5d5d-439b-97b1-822ec4dc756c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.663380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dafb8-dfb2-47cd-8ea3-2cbae8fa43f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.667131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dafb8-dfb2-47cd-8ea3-2cbae8fa43f2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.667602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dafb8-dfb2-47cd-8ea3-2cbae8fa43f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.667898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dafb8-dfb2-47cd-8ea3-2cbae8fa43f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.668780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dafb8-dfb2-47cd-8ea3-2cbae8fa43f2 None admin] RBAC: Adding query filter params (role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=d799f2e4420644cead1a8b3bd804ada6) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:12.669099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dafb8-dfb2-47cd-8ea3-2cbae8fa43f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:12.672044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dafb8-dfb2-47cd-8ea3-2cbae8fa43f2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:12.682661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 151/276] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/role_assignments?user.id=d799f2e4420644cead1a8b3bd804ada6&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=c9b4590007f942458d155393f4a0da83 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:12.684716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057b8b-a54c-4922-af2a-75bec6f9fd01 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.685017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057b8b-a54c-4922-af2a-75bec6f9fd01 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.685299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057b8b-a54c-4922-af2a-75bec6f9fd01 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.687636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 152/277] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:12.694576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734d2c-4a54-4634-ab0f-72bd6e42ad7c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.694871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734d2c-4a54-4634-ab0f-72bd6e42ad7c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.699733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734d2c-4a54-4634-ab0f-72bd6e42ad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.729252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-5b734d2c-4a54-4634-ab0f-72bd6e42ad7c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:12.730350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.730476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5b734d2c-4a54-4634-ab0f-72bd6e42ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:12.731510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.732001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.732528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.733795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:12.734421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:12.736089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:12.746575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 126/278] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:12.755531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.769592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:12.821505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 153/279] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:12.844765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734d2c-4a54-4634-ab0f-72bd6e42ad7c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.874485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bc759-f6d3-4104-94b2-4a671e54acab None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.911508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.912759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.913245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.913718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] PATH_INFO: `/v3/users/de47790e87724ebd9d53c38fb04fdf8d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:12.916849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:12.932891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] RBAC: Authorizing `identity:get_user(user_id=de47790e87724ebd9d53c38fb04fdf8d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:12.934712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:12.936678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 127/280] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/users/de47790e87724ebd9d53c38fb04fdf8d => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:12.943213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:12.954062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734d2c-4a54-4634-ab0f-72bd6e42ad7c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:12.993999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:12.993999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:12.994283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:12.994561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:13.008429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:13.018697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:13.019683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:13.021031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 154/281] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:13.027253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:13.059405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:13.068606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228257d-66fc-4bb5-abed-b8956f9284f2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:13.115166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:13.116384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:13.116988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:13.117350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:13.118277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, user.id=de47790e87724ebd9d53c38fb04fdf8d, scope.system=all) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:13.118666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:13.120345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:13.128773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 128/282] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Jun 20 18:33:12 2022] GET /identity/v3/role_assignments?user.id=de47790e87724ebd9d53c38fb04fdf8d&scope.system=all&role.id=a73d3b84962843cdb2898ec86046e88e => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:13.155453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c972-14d8-4cc4-a56c-02a1efbec8f6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:13.217612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:13.218670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:13.219172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:13.219638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:13.220606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:13.221101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:13.222736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:13.234778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 155/283] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:13.240864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:13.316369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:13.361776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3735-8915-46a0-b5fa-ece1e9d92ea2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:13.399097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:13.400002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:13.400341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:13.400621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] PATH_INFO: `/v3/users/33992df7b47248e59dc917fa28783437` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:13.401831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] RBAC: Authorizing `identity:get_user(user_id=33992df7b47248e59dc917fa28783437)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:13.403314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:13.405368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 129/284] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:13 2022] GET /identity/v3/users/33992df7b47248e59dc917fa28783437 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:13.410723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:13.502117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:13.516621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ff82f-7baf-499c-a130-f5cdd43e09c0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:13.551592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e00f38-10cb-4cf1-bf5e-03cc5dd41883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:13.553068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00f38-10cb-4cf1-bf5e-03cc5dd41883 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:13.553349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00f38-10cb-4cf1-bf5e-03cc5dd41883 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:13.553625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00f38-10cb-4cf1-bf5e-03cc5dd41883 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:13.554824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e00f38-10cb-4cf1-bf5e-03cc5dd41883 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:13.556307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e00f38-10cb-4cf1-bf5e-03cc5dd41883 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:13.558310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 156/285] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:13 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:13.563558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:13.742654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38409adf-82d8-48fc-a303-e6dddfe35c2d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:13.780918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:13.795669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bbbd1-7db0-4b5a-a274-56a7d1ff0146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:13.796594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbbd1-7db0-4b5a-a274-56a7d1ff0146 None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:13.796884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbbd1-7db0-4b5a-a274-56a7d1ff0146 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:13.797166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbbd1-7db0-4b5a-a274-56a7d1ff0146 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/33992df7b47248e59dc917fa28783437/roles/118a743b3fb844bf8f61de225e3365b2` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:13.799213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bbbd1-7db0-4b5a-a274-56a7d1ff0146 None admin] RBAC: Authorizing `identity:create_grant(project_id=e156cfe62c864df8a73d802d59ef75a3, user_id=33992df7b47248e59dc917fa28783437, role_id=118a743b3fb844bf8f61de225e3365b2)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:13.800665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bbbd1-7db0-4b5a-a274-56a7d1ff0146 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:13.835511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 130/286] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:13 2022] PUT /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3/users/33992df7b47248e59dc917fa28783437/roles/118a743b3fb844bf8f61de225e3365b2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:14.315726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2a15f-fd89-40a4-899a-8081d521c19c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:14.316122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2a15f-fd89-40a4-899a-8081d521c19c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:14.316298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2a15f-fd89-40a4-899a-8081d521c19c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:14.318422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 157/287] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:14.323774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a812e-c422-4bf8-beab-405638f02a95 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:14.324069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a812e-c422-4bf8-beab-405638f02a95 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:14.324351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a812e-c422-4bf8-beab-405638f02a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:14.351918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-877a812e-c422-4bf8-beab-405638f02a95 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:14.353098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-877a812e-c422-4bf8-beab-405638f02a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:14.445456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 131/288] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:14.480617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2a15f-fd89-40a4-899a-8081d521c19c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:14.611610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2a15f-fd89-40a4-899a-8081d521c19c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:14.647166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:14.647983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:14.648272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:14.648557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:14.659343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:14.667274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:14.668202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:14.669005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 158/289] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:14.680293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a812e-c422-4bf8-beab-405638f02a95 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:14.862468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a812e-c422-4bf8-beab-405638f02a95 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:14.879366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:14.899977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:14.900659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:14.900944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:14.901219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:14.901976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:14.902283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:14.903680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:14.913320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 132/290] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:14.918692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:14.936101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:15.022522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606608b1-052d-4ef9-8735-76f872aa43d1 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:15.061941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ef14-c81e-4f82-aba6-41eee092351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:15.062841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ef14-c81e-4f82-aba6-41eee092351c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.063162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ef14-c81e-4f82-aba6-41eee092351c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.063438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ef14-c81e-4f82-aba6-41eee092351c None admin] PATH_INFO: `/v3/users/c3921e8a41a84ac1883ea2191074892a` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.065441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ef14-c81e-4f82-aba6-41eee092351c None admin] RBAC: Authorizing `identity:get_user(user_id=c3921e8a41a84ac1883ea2191074892a)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:15.066961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ef14-c81e-4f82-aba6-41eee092351c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:15.068943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 159/291] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:14 2022] GET /identity/v3/users/c3921e8a41a84ac1883ea2191074892a => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:15.074444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:15.206904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39af3f-abf9-4aa9-a38a-78151f6ec3c9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:15.241147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:15.241808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.242093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.242376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.311106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:15.337170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:15.338702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:15.407533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845c9b-1928-4b3e-9cd7-48ddda22d835 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.407852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845c9b-1928-4b3e-9cd7-48ddda22d835 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.408101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845c9b-1928-4b3e-9cd7-48ddda22d835 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.409629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 160/292] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:33:15.418720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dd6cc-114c-4703-8777-f523b5d76633 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.419040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dd6cc-114c-4703-8777-f523b5d76633 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.419322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dd6cc-114c-4703-8777-f523b5d76633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.444579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-be9dd6cc-114c-4703-8777-f523b5d76633 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:15.445784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-be9dd6cc-114c-4703-8777-f523b5d76633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:15.475960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 133/293] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:15.482157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:15.569264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:15.570730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 161/294] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:15.582356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace209-b960-4213-9d49-40cfbf6cd32e None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.582650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace209-b960-4213-9d49-40cfbf6cd32e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.583481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace209-b960-4213-9d49-40cfbf6cd32e None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.585287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 162/295] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:15.590330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e063985-389f-483a-b498-29396d74c63b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.590882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e063985-389f-483a-b498-29396d74c63b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.591508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e063985-389f-483a-b498-29396d74c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.594099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02736eaa-12e6-47ce-8817-81e891ca6a79 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:15.611330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2e063985-389f-483a-b498-29396d74c63b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:15.612754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2e063985-389f-483a-b498-29396d74c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:15.620859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:15.632733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:15.634002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.634493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.635024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.636544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:15.638406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:15.640505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 134/296] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:15 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:15.641560 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:15.688462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 163/297] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:15.695220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e063985-389f-483a-b498-29396d74c63b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:15.789774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242901-fcc8-48a1-b0cc-9e3d90886677 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:15.809414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e063985-389f-483a-b498-29396d74c63b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:15.826545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:15.827390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.827682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.827966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.839264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:15.845140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500c74c-26a8-453f-b035-5856155721e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:15.845802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500c74c-26a8-453f-b035-5856155721e9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.846086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500c74c-26a8-453f-b035-5856155721e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.846366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500c74c-26a8-453f-b035-5856155721e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:15.847036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:15.847909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:15.848771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:15.849399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500c74c-26a8-453f-b035-5856155721e9 None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=c3921e8a41a84ac1883ea2191074892a) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:15.849399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500c74c-26a8-453f-b035-5856155721e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:15.849529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 135/298] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:15.849529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:15.853669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500c74c-26a8-453f-b035-5856155721e9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:15.859175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:15.867055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 164/299] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:15 2022] GET /identity/v3/role_assignments?user.id=c3921e8a41a84ac1883ea2191074892a&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=a73d3b84962843cdb2898ec86046e88e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:15.867055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7c007-f28e-4e57-acd3-4cab502f1709 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:15.867055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7c007-f28e-4e57-acd3-4cab502f1709 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:15.867055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7c007-f28e-4e57-acd3-4cab502f1709 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:15.867055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 165/300] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:15.867055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7c007-f28e-4e57-acd3-4cab502f1709 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:15.877424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:15.973486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f57aa-2c83-412b-8eb1-ba9e8a254c24 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.013110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7455f-b0e2-446a-9c4e-85f4e9d72457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.013935 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7455f-b0e2-446a-9c4e-85f4e9d72457 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.014221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7455f-b0e2-446a-9c4e-85f4e9d72457 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.014547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7455f-b0e2-446a-9c4e-85f4e9d72457 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.015706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7455f-b0e2-446a-9c4e-85f4e9d72457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:16.016210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7c007-f28e-4e57-acd3-4cab502f1709 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.017269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7455f-b0e2-446a-9c4e-85f4e9d72457 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:16.019982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 136/301] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:16.020785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f995-8adf-428e-a6af-63465744b27a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.021077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f995-8adf-428e-a6af-63465744b27a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.021410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f995-8adf-428e-a6af-63465744b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.039735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-62f2f995-8adf-428e-a6af-63465744b27a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:16.041035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-62f2f995-8adf-428e-a6af-63465744b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:16.054962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.055803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.056718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.056718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.057174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:16.057486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:16.058943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:16.070569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 166/302] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:16.071509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.141332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 137/303] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:16.147028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f995-8adf-428e-a6af-63465744b27a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.147028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:16.159856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:16.198427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb819a-624e-4fac-a67f-1fb3d160843b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.243501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.244172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.244458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.244891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] PATH_INFO: `/v3/groups` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.245616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:16.247146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:16.259143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f995-8adf-428e-a6af-63465744b27a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.274942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 167/304] 10.222.0.43 () {60 vars in 1134 bytes} [Mon Jun 20 18:33:16 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:16.274942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.311477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.312602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.312891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.313175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] PATH_INFO: `/v3/users/cb9a918d637140358417c73e3afbf97c` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.332142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9a918d637140358417c73e3afbf97c)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:16.334363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:16.336917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 138/305] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:16 2022] GET /identity/v3/users/cb9a918d637140358417c73e3afbf97c => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:16.342498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.395757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866f128-d7c2-400c-815e-364e9278538c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.423910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:16.430269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:16.441707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e233-bc88-4119-a011-63e2720c44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.443934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e233-bc88-4119-a011-63e2720c44c8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.443934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e233-bc88-4119-a011-63e2720c44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.443934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e233-bc88-4119-a011-63e2720c44c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.456137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5e233-bc88-4119-a011-63e2720c44c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-7ab5e233-bc88-4119-a011-63e2720c44c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:16.464150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:16.465094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 168/306] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:16.466782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795426a-23ac-4579-af01-583bd470a4b4 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.467530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795426a-23ac-4579-af01-583bd470a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.467530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795426a-23ac-4579-af01-583bd470a4b4 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.468652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 169/307] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:16.471413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795426a-23ac-4579-af01-583bd470a4b4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.477965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a40e4-1e3d-44b1-a12a-146c512c4863 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.518666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbc4e6-01a2-49aa-802f-a33489caf36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.519677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc4e6-01a2-49aa-802f-a33489caf36c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.519980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc4e6-01a2-49aa-802f-a33489caf36c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.520300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc4e6-01a2-49aa-802f-a33489caf36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.521147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc4e6-01a2-49aa-802f-a33489caf36c None admin] RBAC: Adding query filter params (role.id=118a743b3fb844bf8f61de225e3365b2, user.id=cb9a918d637140358417c73e3afbf97c, scope.system=all) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:16.521468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc4e6-01a2-49aa-802f-a33489caf36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:16.522907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc4e6-01a2-49aa-802f-a33489caf36c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:16.528470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 139/308] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Jun 20 18:33:16 2022] GET /identity/v3/role_assignments?user.id=cb9a918d637140358417c73e3afbf97c&scope.system=all&role.id=118a743b3fb844bf8f61de225e3365b2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:16.529654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bf05-d5ab-4578-841f-edb1ea8dcf73 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.529945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bf05-d5ab-4578-841f-edb1ea8dcf73 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.530229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bf05-d5ab-4578-841f-edb1ea8dcf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.559277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6f88bf05-d5ab-4578-841f-edb1ea8dcf73 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:16.560512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6f88bf05-d5ab-4578-841f-edb1ea8dcf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:16.594675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795426a-23ac-4579-af01-583bd470a4b4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.641256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.643261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.643913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.644452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.645439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:16.646089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:16.648427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:16.665214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 140/309] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:16.665403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 170/310] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:16.666178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88bf05-d5ab-4578-841f-edb1ea8dcf73 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.688651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.752589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:16.755589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:16.802758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88bf05-d5ab-4578-841f-edb1ea8dcf73 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.811760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e97df-27c1-400c-898b-7f73f9c1f2b6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:16.849111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.850158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:16.850434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.850859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.851296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.851441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:16.851833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:16.852203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] PATH_INFO: `/v3/users/de47790e87724ebd9d53c38fb04fdf8d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:16.853525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] RBAC: Authorizing `identity:get_user(user_id=de47790e87724ebd9d53c38fb04fdf8d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:16.855840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:16.858258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 141/311] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:16 2022] GET /identity/v3/users/de47790e87724ebd9d53c38fb04fdf8d => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:16.863284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.867505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:16.875789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:16.876866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:16.877719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:16.885432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 171/312] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:16.886513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:16.981387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5e10-38ae-4a72-a12b-df91a2035d08 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:17.005511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5fce3-533a-4537-9ba4-3132cc0a0fc8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:17.012349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:17.017987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:17.023730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:17.024923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:17.025428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:17.025904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] PATH_INFO: `/v3/system/users/de47790e87724ebd9d53c38fb04fdf8d/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:17.029311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de47790e87724ebd9d53c38fb04fdf8d, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:17.030943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:17.041968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 142/313] 10.222.0.43 () {58 vars in 1334 bytes} [Mon Jun 20 18:33:16 2022] PUT /identity/v3/system/users/de47790e87724ebd9d53c38fb04fdf8d/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:33:17.046040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:17.047149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:17.047686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:17.048167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:17.049255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:17.049824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:17.052113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:17.065172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 172/314] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:17.071617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:17.185509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deb537-13d9-452b-884d-61a24ac69994 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:17.221131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:17.222083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:17.222369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:17.222645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] PATH_INFO: `/v3/users/33992df7b47248e59dc917fa28783437` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:17.224422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] RBAC: Authorizing `identity:get_user(user_id=33992df7b47248e59dc917fa28783437)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:17.225879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:17.227841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 143/315] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:17 2022] GET /identity/v3/users/33992df7b47248e59dc917fa28783437 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:17.233158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:17.338081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fc41c-5275-41ab-9130-38b20718c446 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:17.372640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:17.373619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:17.374129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:17.374607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:17.435325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:17.447372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:17.449267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:17.552490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 173/316] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 18:33:17.558229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:17.621455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:17.669621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce3ad8-123a-4ea5-a20f-69b841c11614 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:17.708233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abb25f-0dd7-4ba6-8b2c-d29146413923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:17.709470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abb25f-0dd7-4ba6-8b2c-d29146413923 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:17.709961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abb25f-0dd7-4ba6-8b2c-d29146413923 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:17.710440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abb25f-0dd7-4ba6-8b2c-d29146413923 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:17.711885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abb25f-0dd7-4ba6-8b2c-d29146413923 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:17.713628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abb25f-0dd7-4ba6-8b2c-d29146413923 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:17.716179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 144/317] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:17 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:17.721702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:17.793704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:17.825180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d78b5-82d7-45e6-8500-af46a6b9db62 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:17.858903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab424-77e4-416d-bb1b-66ce247a364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:17.859907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab424-77e4-416d-bb1b-66ce247a364c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:17.860388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab424-77e4-416d-bb1b-66ce247a364c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:17.860859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab424-77e4-416d-bb1b-66ce247a364c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:17.861907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ab424-77e4-416d-bb1b-66ce247a364c None admin] RBAC: Adding query filter params (role.id=118a743b3fb844bf8f61de225e3365b2, scope.project.id=e156cfe62c864df8a73d802d59ef75a3, user.id=33992df7b47248e59dc917fa28783437) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:17.862415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ab424-77e4-416d-bb1b-66ce247a364c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:17.864584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ab424-77e4-416d-bb1b-66ce247a364c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:17.871024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 174/318] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:17 2022] GET /identity/v3/role_assignments?user.id=33992df7b47248e59dc917fa28783437&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=118a743b3fb844bf8f61de225e3365b2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:18.398596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3858d-118b-48e7-8c72-c6b26af250fa None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:18.399161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3858d-118b-48e7-8c72-c6b26af250fa None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:18.399161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3858d-118b-48e7-8c72-c6b26af250fa None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:18.400691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 145/319] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:18.405719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916c68-0a5c-4056-a08e-dc518ae0e63b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:18.406016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916c68-0a5c-4056-a08e-dc518ae0e63b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:18.406546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916c68-0a5c-4056-a08e-dc518ae0e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:18.423856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-75916c68-0a5c-4056-a08e-dc518ae0e63b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:18.425033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-75916c68-0a5c-4056-a08e-dc518ae0e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:18.491390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 175/320] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:18.513153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3858d-118b-48e7-8c72-c6b26af250fa None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:18.611501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3858d-118b-48e7-8c72-c6b26af250fa None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:18.618474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449afb2-1dbf-4eaa-bb9c-65d4286d2a9c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:18.618775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449afb2-1dbf-4eaa-bb9c-65d4286d2a9c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:18.619117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449afb2-1dbf-4eaa-bb9c-65d4286d2a9c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:18.620512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 176/321] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:18.625570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dacc0-6c60-4cbe-ab7a-83184698a9e0 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:18.625867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dacc0-6c60-4cbe-ab7a-83184698a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:18.626156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dacc0-6c60-4cbe-ab7a-83184698a9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:18.637998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:18.642839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-272dacc0-6c60-4cbe-ab7a-83184698a9e0 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:18.644051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-272dacc0-6c60-4cbe-ab7a-83184698a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:18.651144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:18.651893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:18.652584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:18.652869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:18.654409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:18.656474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:18.661607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 146/322] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:18.665151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:18.719704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:18.729937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 177/323] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:18.751783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dacc0-6c60-4cbe-ab7a-83184698a9e0 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:18.777368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23acd9a-e3cb-493e-9abc-fce729e2dacf None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:18.813815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:18.814503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:18.814978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:18.815270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] PATH_INFO: `/v3/groups` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:18.816588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:18.818075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:18.846942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 147/324] 10.222.0.43 () {60 vars in 1134 bytes} [Mon Jun 20 18:33:18 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:33:18.860293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dacc0-6c60-4cbe-ab7a-83184698a9e0 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:18.899869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:18.900704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:18.900998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:18.901336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:18.913247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:18.921342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:18.922299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:18.927626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 178/325] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:18.931435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:18.990812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:19.043875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447dcbe-2773-4f9a-989a-dcdfc778c32d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:19.084730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f6089-6ef4-4bec-921c-f97edcb84bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:19.085420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f6089-6ef4-4bec-921c-f97edcb84bab None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.085713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f6089-6ef4-4bec-921c-f97edcb84bab None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.085999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f6089-6ef4-4bec-921c-f97edcb84bab None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.086822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f6089-6ef4-4bec-921c-f97edcb84bab None admin] RBAC: Adding query filter params (name=reader) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:19.087183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f6089-6ef4-4bec-921c-f97edcb84bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:19.088570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f6089-6ef4-4bec-921c-f97edcb84bab None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:19.098788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 148/326] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:19.104152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:19.165462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:19.190727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040612e4-b607-4c53-bba0-ad0c8fe5d9c3 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.191106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040612e4-b607-4c53-bba0-ad0c8fe5d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.191323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040612e4-b607-4c53-bba0-ad0c8fe5d9c3 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.193386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 149/327] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:33:19.200450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40b0a-e243-44f4-abb5-fb958d391d21 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.200744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40b0a-e243-44f4-abb5-fb958d391d21 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.201028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a40b0a-e243-44f4-abb5-fb958d391d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.217673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc4aa-46bd-4fb6-964a-425f76e40c61 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:19.226189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-49a40b0a-e243-44f4-abb5-fb958d391d21 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:19.227417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-49a40b0a-e243-44f4-abb5-fb958d391d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:19.265720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:19.266870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.267191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.269164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] PATH_INFO: `/v3/users/cb9a918d637140358417c73e3afbf97c` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.269164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9a918d637140358417c73e3afbf97c)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:19.271087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:19.272552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 179/328] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:19 2022] GET /identity/v3/users/cb9a918d637140358417c73e3afbf97c => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:19.277885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:19.322261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 150/329] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:19.349729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a40b0a-e243-44f4-abb5-fb958d391d21 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:19.396011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31348d9-828f-45d1-b15b-7d1a708a8535 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:19.408016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:19.432840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:19.439618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:19.440779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.441070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.442283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] PATH_INFO: `/v3/system/users/cb9a918d637140358417c73e3afbf97c/roles/118a743b3fb844bf8f61de225e3365b2` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.444661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cb9a918d637140358417c73e3afbf97c, role_id=118a743b3fb844bf8f61de225e3365b2)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:19.446150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:19.462931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 180/330] 10.222.0.43 () {58 vars in 1334 bytes} [Mon Jun 20 18:33:19 2022] PUT /identity/v3/system/users/cb9a918d637140358417c73e3afbf97c/roles/118a743b3fb844bf8f61de225e3365b2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:33:19.500553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a40b0a-e243-44f4-abb5-fb958d391d21 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:19.544448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:19.545288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.545579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.545865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.560584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:19.568796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:19.569751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:19.570557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 151/331] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:19.576319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:19.705742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4cae6-43ad-4dd1-9d1e-f0b1bd320eff None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:19.743409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:19.744133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.744397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.744733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.745453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:19.745763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:19.747205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:19.756989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 181/332] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:19.762519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:19.894404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf0541-e5c7-4c18-888b-e562cfa6d00b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:19.899890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:19.943634 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562041-1f43-4140-a022-92a2ea4e20d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:19.944898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562041-1f43-4140-a022-92a2ea4e20d4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:19.945413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562041-1f43-4140-a022-92a2ea4e20d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:19.945896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562041-1f43-4140-a022-92a2ea4e20d4 None admin] PATH_INFO: `/v3/users/de47790e87724ebd9d53c38fb04fdf8d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:19.947388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a562041-1f43-4140-a022-92a2ea4e20d4 None admin] RBAC: Authorizing `identity:get_user(user_id=de47790e87724ebd9d53c38fb04fdf8d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:19.949177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a562041-1f43-4140-a022-92a2ea4e20d4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:19.951483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 152/333] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:19 2022] GET /identity/v3/users/de47790e87724ebd9d53c38fb04fdf8d => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:19.957588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:20.032624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:20.101933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00016898-6113-4107-8205-2e2ea13c1dbf None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:20.141172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799818fe-6a0c-4f4d-871f-403382c10839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:20.141870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799818fe-6a0c-4f4d-871f-403382c10839 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:20.142161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799818fe-6a0c-4f4d-871f-403382c10839 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:20.142441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799818fe-6a0c-4f4d-871f-403382c10839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:20.143347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799818fe-6a0c-4f4d-871f-403382c10839 None admin] RBAC: Adding query filter params (role.id=a73d3b84962843cdb2898ec86046e88e, user.id=de47790e87724ebd9d53c38fb04fdf8d, scope.system=all) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:20.143662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799818fe-6a0c-4f4d-871f-403382c10839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:20.145687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799818fe-6a0c-4f4d-871f-403382c10839 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:20.162869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 182/334] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Jun 20 18:33:19 2022] GET /identity/v3/role_assignments?user.id=de47790e87724ebd9d53c38fb04fdf8d&scope.system=all&role.id=a73d3b84962843cdb2898ec86046e88e => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:21.494962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e281-7317-4a80-8c00-3fe878016694 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:21.495923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e281-7317-4a80-8c00-3fe878016694 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:21.496420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e281-7317-4a80-8c00-3fe878016694 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:21.498225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 153/335] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:21.512521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3302a-d080-4602-b1b6-1af3ae23c016 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:21.512986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3302a-d080-4602-b1b6-1af3ae23c016 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:21.513171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3302a-d080-4602-b1b6-1af3ae23c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:21.535981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4ba3302a-d080-4602-b1b6-1af3ae23c016 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:21.537178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4ba3302a-d080-4602-b1b6-1af3ae23c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:21.624364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 183/336] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:21.667454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e281-7317-4a80-8c00-3fe878016694 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:21.796914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e281-7317-4a80-8c00-3fe878016694 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:21.841259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:21.842075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:21.842366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:21.842657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:21.857478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:21.866089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:21.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:21.867850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 154/337] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:21.875308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3302a-d080-4602-b1b6-1af3ae23c016 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:21.937943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:22.010462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3302a-d080-4602-b1b6-1af3ae23c016 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:22.050464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1be88-b404-4f14-a120-d9efd8ff9879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:22.051095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1be88-b404-4f14-a120-d9efd8ff9879 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.051516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1be88-b404-4f14-a120-d9efd8ff9879 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.052378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1be88-b404-4f14-a120-d9efd8ff9879 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.053174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1be88-b404-4f14-a120-d9efd8ff9879 None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:22.053495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1be88-b404-4f14-a120-d9efd8ff9879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:22.054938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1be88-b404-4f14-a120-d9efd8ff9879 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:22.064141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 184/338] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:22.069682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:22.131992 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:22.182448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e977d-ebd3-4598-953d-29448f2f070b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.182776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e977d-ebd3-4598-953d-29448f2f070b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.183079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e977d-ebd3-4598-953d-29448f2f070b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.184730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 185/339] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:22.193294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef2b61-b574-47db-8b30-c684367f1ce7 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.193589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef2b61-b574-47db-8b30-c684367f1ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.193873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef2b61-b574-47db-8b30-c684367f1ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.214720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd902b1-1985-4add-b151-971124c6eb52 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:22.220819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4bef2b61-b574-47db-8b30-c684367f1ce7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:22.222027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4bef2b61-b574-47db-8b30-c684367f1ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:22.272526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:22.273587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.274087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.274565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.333808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 186/340] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:22.337402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be388bc-7d84-4ba9-8e17-4489d61077f9 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.337708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be388bc-7d84-4ba9-8e17-4489d61077f9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.337995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be388bc-7d84-4ba9-8e17-4489d61077f9 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.339600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 187/341] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:22.351281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00aaf7-0676-4db6-b804-a0ea6faf0fa4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.351578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00aaf7-0676-4db6-b804-a0ea6faf0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.351864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00aaf7-0676-4db6-b804-a0ea6faf0fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.383316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:22.385111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:22.387930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-5c00aaf7-0676-4db6-b804-a0ea6faf0fa4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:22.389143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5c00aaf7-0676-4db6-b804-a0ea6faf0fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:22.421656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:22.452330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:22.507866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 155/342] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:22.509596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:22.572575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 188/343] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:22.572575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00aaf7-0676-4db6-b804-a0ea6faf0fa4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:22.656903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3758-07a4-4ad1-82f7-11f42f3b08e9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:22.690733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:22.703654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:22.704837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.705325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.705803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.706379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00aaf7-0676-4db6-b804-a0ea6faf0fa4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:22.729563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:22.737541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:22.738453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:22.739309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 156/344] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:22.739991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:22.758126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cc8ed-9aa1-4823-a834-df0cb7b2f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:22.759061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc8ed-9aa1-4823-a834-df0cb7b2f014 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.760291 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc8ed-9aa1-4823-a834-df0cb7b2f014 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.760597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc8ed-9aa1-4823-a834-df0cb7b2f014 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.762817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cc8ed-9aa1-4823-a834-df0cb7b2f014 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:22.764338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cc8ed-9aa1-4823-a834-df0cb7b2f014 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:22.766368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 189/345] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:22 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:22.770952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07fbe-8f61-4ee7-8cd9-e7169a6e2ef5 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.770952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07fbe-8f61-4ee7-8cd9-e7169a6e2ef5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.770952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07fbe-8f61-4ee7-8cd9-e7169a6e2ef5 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.771518 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 190/346] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:22.772517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07fbe-8f61-4ee7-8cd9-e7169a6e2ef5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:22.802519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:22.863711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea9ca-5120-44db-b9de-1a39edc63b03 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:22.887272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07fbe-8f61-4ee7-8cd9-e7169a6e2ef5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:22.905160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d668a6-5ebb-4ff4-bb82-a904fd5bc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:22.906657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d668a6-5ebb-4ff4-bb82-a904fd5bc434 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.907348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d668a6-5ebb-4ff4-bb82-a904fd5bc434 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.907946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d668a6-5ebb-4ff4-bb82-a904fd5bc434 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.920104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d668a6-5ebb-4ff4-bb82-a904fd5bc434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:22.925705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:22.926426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.926717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.927027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.927794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:22.928108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:22.929513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-e1d668a6-5ebb-4ff4-bb82-a904fd5bc434 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:22.930436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:22.931447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:22.932270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:22.937811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 157/347] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:22.939211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 191/348] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:22.939606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc87b3-fe6a-4ff6-8e04-c8dff991fc90 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:22.940047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:22.940341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc87b3-fe6a-4ff6-8e04-c8dff991fc90 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:22.940823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc87b3-fe6a-4ff6-8e04-c8dff991fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:22.962184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-dadc87b3-fe6a-4ff6-8e04-c8dff991fc90 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:22.963769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dadc87b3-fe6a-4ff6-8e04-c8dff991fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:23.016088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.037621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.040879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 158/349] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:23.041975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc87b3-fe6a-4ff6-8e04-c8dff991fc90 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:23.048091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74807e26-6ba0-40b5-bf24-b7cf92704145 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:23.096568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:23.097455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.097911 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.098018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.107014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:23.108514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:23.110336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 192/350] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:22 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:23.110994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:23.163686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc87b3-fe6a-4ff6-8e04-c8dff991fc90 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:23.210227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:23.210896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.211227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.211511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.237642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92374c29-47f8-4492-bab9-611221146de5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:23.284146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.286574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003cf36-57dd-47d5-b926-bfba0ce3bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:23.287302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003cf36-57dd-47d5-b926-bfba0ce3bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.287597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003cf36-57dd-47d5-b926-bfba0ce3bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.288260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003cf36-57dd-47d5-b926-bfba0ce3bcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.288673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003cf36-57dd-47d5-b926-bfba0ce3bcb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:23.289003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003cf36-57dd-47d5-b926-bfba0ce3bcb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:23.290346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003cf36-57dd-47d5-b926-bfba0ce3bcb1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:23.299759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 193/351] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:23.301100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3df21-469f-476c-88fc-393f6b873f31 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.301920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3df21-469f-476c-88fc-393f6b873f31 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.302208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3df21-469f-476c-88fc-393f6b873f31 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.303741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 194/352] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:23.304456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3df21-469f-476c-88fc-393f6b873f31 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:23.318130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:23.319944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:23.325350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.431285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3df21-469f-476c-88fc-393f6b873f31 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:23.446155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 159/353] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:23.446816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:23.483054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edc018-f39f-42a5-bb2d-cdc311c120aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:23.483930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edc018-f39f-42a5-bb2d-cdc311c120aa None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.484226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edc018-f39f-42a5-bb2d-cdc311c120aa None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.484507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edc018-f39f-42a5-bb2d-cdc311c120aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.498182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edc018-f39f-42a5-bb2d-cdc311c120aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-40edc018-f39f-42a5-bb2d-cdc311c120aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:23.507132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:23.508043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 18:33:23.508839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:23.511190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 195/354] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:23.512636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4396b-ccab-4b7f-9a42-02b9ad660820 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.513129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4396b-ccab-4b7f-9a42-02b9ad660820 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.513683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4396b-ccab-4b7f-9a42-02b9ad660820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.533716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3bb4396b-ccab-4b7f-9a42-02b9ad660820 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:23.535390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3bb4396b-ccab-4b7f-9a42-02b9ad660820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:23.544081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.570653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6984fd-0ff3-4484-a23b-8b0b7e63e510 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:23.613782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:23.615979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.616517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.617055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.618066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=33de371567f9414098226ad9427441e5) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:23.618387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:23.619854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 196/355] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:23.620286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:23.620722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4396b-ccab-4b7f-9a42-02b9ad660820 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:23.626071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 160/356] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:23 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=33de371567f9414098226ad9427441e5&role.id=a73d3b84962843cdb2898ec86046e88e => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:23.626880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:23.636562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.768524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4396b-ccab-4b7f-9a42-02b9ad660820 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:23.776480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc12ba-f018-44ad-88ac-57c39252cf92 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:23.813151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:23.813803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.814095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.814380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.824394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:23.825717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:23.826229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:23.826516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:23.827791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:23.829948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:23.832045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 161/357] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:23 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:23.837613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:23.853698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.917387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:23.919391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:23.928979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:23.964961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a2fd-77f5-4cd7-a030-45746a84af4f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.001086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.001303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.001526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.001808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.002572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:24.002885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.004461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.014609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 162/358] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.015543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.037253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 197/359] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:24.038318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.119491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:24.152002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c80cb3-861f-4060-9fe0-78e4fc260d14 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.163509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e9e78-ff95-49c3-918c-a5dda18740b7 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.172471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:24.195427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.196741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.197192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.197825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.212637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:24.214600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f3b5-f664-4921-9e77-cbda6a6611bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.215509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f3b5-f664-4921-9e77-cbda6a6611bb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.215789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f3b5-f664-4921-9e77-cbda6a6611bb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.216065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f3b5-f664-4921-9e77-cbda6a6611bb None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.217297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f3b5-f664-4921-9e77-cbda6a6611bb None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.218706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f3b5-f664-4921-9e77-cbda6a6611bb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.220642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 198/360] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:24.220939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:24.221826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:24.223118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:24.224762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696903-0c75-4fc9-9f1f-09dacffc57b1 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.224762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696903-0c75-4fc9-9f1f-09dacffc57b1 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.224905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 163/361] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:24.224990 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696903-0c75-4fc9-9f1f-09dacffc57b1 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.225068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.227800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 199/362] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:24.228562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce696903-0c75-4fc9-9f1f-09dacffc57b1 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.359910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce696903-0c75-4fc9-9f1f-09dacffc57b1 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.378289 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229148-cc60-4083-b7b5-95e4711028d0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.405156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.406120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.406663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.406962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.408197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.409654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.411858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 200/363] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.412760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.427853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.428754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.429041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.429320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] PATH_INFO: `/v3/users/cb9a918d637140358417c73e3afbf97c` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.431686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9a918d637140358417c73e3afbf97c)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.433163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.436035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 164/364] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/users/cb9a918d637140358417c73e3afbf97c => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.436833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.442687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:24.470389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:24.553890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8165-c048-4ad8-aabe-27aa801e1ff6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.586545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64687e-4b35-4c5f-955d-c7809b6810e9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.594533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358235a5-1692-44b7-87ad-d264d8f29989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.595248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358235a5-1692-44b7-87ad-d264d8f29989 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.595611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358235a5-1692-44b7-87ad-d264d8f29989 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.596169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358235a5-1692-44b7-87ad-d264d8f29989 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.596942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358235a5-1692-44b7-87ad-d264d8f29989 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:24.597568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358235a5-1692-44b7-87ad-d264d8f29989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.599771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358235a5-1692-44b7-87ad-d264d8f29989 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.609664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 201/365] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.611013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8279-a167-4145-9311-dbe7047d3286 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.611243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8279-a167-4145-9311-dbe7047d3286 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.611527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8279-a167-4145-9311-dbe7047d3286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.632837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.633588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.633876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.634161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.634770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-5f6a8279-a167-4145-9311-dbe7047d3286 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:24.635217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=e156cfe62c864df8a73d802d59ef75a3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:24.635380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.636768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5f6a8279-a167-4145-9311-dbe7047d3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:24.636919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.644141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 165/366] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=a73d3b84962843cdb2898ec86046e88e => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.645619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.721279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:24.730070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 202/367] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:24.731283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8279-a167-4145-9311-dbe7047d3286 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.775611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:24.788124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549ed0-47e6-4259-a5ee-1e258b3b8548 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.837477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.838417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.838706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.839015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.840323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.841824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.843978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 166/368] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.844816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.871682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8279-a167-4145-9311-dbe7047d3286 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:24.921217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:24.922502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:24.923245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:24.924162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:24.925345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] RBAC: Adding query filter params (role.id=118a743b3fb844bf8f61de225e3365b2, user.id=cb9a918d637140358417c73e3afbf97c, scope.system=all) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:24.925860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:24.927800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:24.943753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 203/369] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/role_assignments?user.id=cb9a918d637140358417c73e3afbf97c&scope.system=all&role.id=118a743b3fb844bf8f61de225e3365b2 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:24.945958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:24.989743 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f394d5-b250-4f51-a1c2-33c156553440 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:25.036561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:25.037978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:25.038777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:25.039390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:25.044841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:25.059315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:25.064363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e73d9d-396d-468c-9181-a9499c9f2f4b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:25.101567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:25.102385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:25.102671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:25.102994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:25.114392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:25.128579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:25.130071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:25.130886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:25.131537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:25.133083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:25.135449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 204/370] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:25.136449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:25.274068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279506f-7987-4a7a-989e-83b65b896116 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:25.313818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:25.314385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:25.314675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:25.314994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:25.315850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=33de371567f9414098226ad9427441e5) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:25.316164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:25.319224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:25.324442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 205/371] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:25 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=33de371567f9414098226ad9427441e5&role.id=c9b4590007f942458d155393f4a0da83 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:25.325280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:25.351444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:25.367135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 167/372] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:25.372804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:25.456527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27001501-14e8-42ca-b090-223b1a4afe5e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:25.468001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:25.503495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:25.504199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:25.504574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:25.505337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:25.506115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:25.506436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:25.507884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:25.533238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 206/373] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:25.539053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:25.581655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd189-f32e-47b2-b45a-7f8ae3d081b1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:25.625638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:25.626523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:25.626815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:25.627119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:25.632142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:25.633606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:25.643924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 168/374] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:25 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:25.644819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:25.763352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a787c-e9bb-438e-8e70-b0fb4f1d3535 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:25.766314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:25.771131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:25.817947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a20089-638b-4e2b-aa22-fe9c39e903d4 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:25.831074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:25.831960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:25.832252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:25.832569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:25.835719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:25.837179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:25.839012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 169/375] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:25 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:25.848114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:25.874693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:25.875777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:25.876321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:25.876819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:25.955626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:25.957612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:26.056154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5e8d1-0af5-4916-9107-eea6afb73209 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:26.060535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:26.104405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 207/376] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 18:33:26.108608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:26.135003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f536e-8310-4b52-8525-d08855c9744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:26.136061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f536e-8310-4b52-8525-d08855c9744e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.136578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f536e-8310-4b52-8525-d08855c9744e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.137061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f536e-8310-4b52-8525-d08855c9744e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.138275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f536e-8310-4b52-8525-d08855c9744e None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=e156cfe62c864df8a73d802d59ef75a3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:26.138794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f536e-8310-4b52-8525-d08855c9744e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:26.140617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f536e-8310-4b52-8525-d08855c9744e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:26.150198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 170/377] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:25 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=c9b4590007f942458d155393f4a0da83 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:26.151819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0990fb-1e99-4ec7-81f1-c0f376665c47 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.152334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0990fb-1e99-4ec7-81f1-c0f376665c47 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.152815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0990fb-1e99-4ec7-81f1-c0f376665c47 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.159463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 171/378] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:26.168443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffef0e-9e71-4874-949e-09ed932fa157 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.169060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffef0e-9e71-4874-949e-09ed932fa157 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.169547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffef0e-9e71-4874-949e-09ed932fa157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.202417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2cffef0e-9e71-4874-949e-09ed932fa157 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:26.203979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2cffef0e-9e71-4874-949e-09ed932fa157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:26.246710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630464a3-c98d-44e5-b297-4d7834328e03 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:26.301107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:26.302195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.302489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.302773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] PATH_INFO: `/v3/projects/a0b525758c904932afef5b70ff9bce58` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.304402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:26.308022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b525758c904932afef5b70ff9bce58)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:26.310374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:26.312474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 208/379] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:26 2022] GET /identity/v3/projects/a0b525758c904932afef5b70ff9bce58 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:26.318001 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:26.363509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 172/380] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:26.389875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffef0e-9e71-4874-949e-09ed932fa157 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:26.395838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:26.477186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4149f8-645d-4880-9673-571ebfe71ef6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:26.521090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffef0e-9e71-4874-949e-09ed932fa157 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:26.523218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:26.525006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.525296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.525581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] PATH_INFO: `/v3/groups/d1ebfa68ac314252ab55d1a45c41a13f` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.531675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] RBAC: Authorizing `identity:get_group(group_id=d1ebfa68ac314252ab55d1a45c41a13f)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:26.534023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:26.536636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 209/381] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:26 2022] GET /identity/v3/groups/d1ebfa68ac314252ab55d1a45c41a13f => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:26.541816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:26.573224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:26.574274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.574571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.574857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.590062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:26.600879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:26.601794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:26.602586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 173/382] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:26.609386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:26.648829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:26.664847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b489-85d2-4a6c-9d1a-4aa6f1c3cf1f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:26.677931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:26.715663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:26.716832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.716832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.716965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.717731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] RBAC: Adding query filter params (group.id=d1ebfa68ac314252ab55d1a45c41a13f, role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=a0b525758c904932afef5b70ff9bce58) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:26.718047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:26.719523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:26.725920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 210/383] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:26 2022] GET /identity/v3/role_assignments?group.id=d1ebfa68ac314252ab55d1a45c41a13f&scope.project.id=a0b525758c904932afef5b70ff9bce58&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:26.756159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7f200-bcf6-4024-9569-47426e6de63c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:26.794226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:26.795226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.795660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.796086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.796995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:26.797451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:26.799116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:26.809208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 174/384] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:26.814618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:26.940825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739d1b2-5fcf-4fac-8463-05bec0b5dbe8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:26.977387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:26.978576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:26.979052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:26.979475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:26.980880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:26.982479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:26.984626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 211/385] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:26 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:26.990670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:27.087052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:27.099917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f1491-81a0-413d-9719-9633a994dd5d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:27.135756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194ebd9-a2f1-4b9b-bdba-6c6d43a80e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:27.136904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ebd9-a2f1-4b9b-bdba-6c6d43a80e03 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.137339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ebd9-a2f1-4b9b-bdba-6c6d43a80e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.137763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ebd9-a2f1-4b9b-bdba-6c6d43a80e03 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.139129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194ebd9-a2f1-4b9b-bdba-6c6d43a80e03 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:27.140716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194ebd9-a2f1-4b9b-bdba-6c6d43a80e03 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:27.142889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 175/386] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:26 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:27.148887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:27.190514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3d35-f193-49d7-b12b-e9bf3bd372a1 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.190819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3d35-f193-49d7-b12b-e9bf3bd372a1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.195283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3d35-f193-49d7-b12b-e9bf3bd372a1 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.197185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 176/387] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:33:27.202499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02c320-f8f7-451b-bbc1-1164f91b714b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.203066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02c320-f8f7-451b-bbc1-1164f91b714b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.203557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02c320-f8f7-451b-bbc1-1164f91b714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.214497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:27.221854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7c02c320-f8f7-451b-bbc1-1164f91b714b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:27.224326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7c02c320-f8f7-451b-bbc1-1164f91b714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:27.297305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8346-4fc9-4066-ab28-8e50af039a60 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:27.334026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 177/388] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:27.343648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:27.344574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.344864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.345144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5/groups/475e564ecab84be793c173a3bf52088b/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.347269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] RBAC: Authorizing `identity:create_grant(project_id=33de371567f9414098226ad9427441e5, group_id=475e564ecab84be793c173a3bf52088b, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:27.348780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:27.359020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02c320-f8f7-451b-bbc1-1164f91b714b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:27.385282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 212/389] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Jun 20 18:33:27 2022] PUT /identity/v3/projects/33de371567f9414098226ad9427441e5/groups/475e564ecab84be793c173a3bf52088b/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:27.493067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:27.523356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02c320-f8f7-451b-bbc1-1164f91b714b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:27.561313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:27.562138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.562428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.562729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.574087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:27.581945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:27.583519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:27.584418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 178/390] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:27.591721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:27.724564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1fb7b-844f-418e-aa42-3a064f343b9a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:27.747470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:27.763023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6974ef3-49e6-4bb0-9618-db502ceb9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:27.764046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6974ef3-49e6-4bb0-9618-db502ceb9324 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.764550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6974ef3-49e6-4bb0-9618-db502ceb9324 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.765047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6974ef3-49e6-4bb0-9618-db502ceb9324 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.766028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6974ef3-49e6-4bb0-9618-db502ceb9324 None admin] RBAC: Adding query filter params (name=member) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:27.766564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6974ef3-49e6-4bb0-9618-db502ceb9324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:27.768239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6974ef3-49e6-4bb0-9618-db502ceb9324 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:27.777682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 213/391] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:27.784132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:27.935465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c019f-d261-4d41-8cb4-911edf5aacb0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:27.975311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73ee68-5b3b-4d1c-afb6-0c1953bf0713 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.975856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73ee68-5b3b-4d1c-afb6-0c1953bf0713 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.975856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73ee68-5b3b-4d1c-afb6-0c1953bf0713 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.977546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 214/392] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:27.982785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2cdd-597f-4d8e-a6f6-a204f01f2921 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.983231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2cdd-597f-4d8e-a6f6-a204f01f2921 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.983608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2cdd-597f-4d8e-a6f6-a204f01f2921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.986264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:27.987264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:27.987553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:27.987836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:27.991618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:27.993097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:27.995096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 179/393] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:27 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:28.000918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fa0b2cdd-597f-4d8e-a6f6-a204f01f2921 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:28.001204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:28.002111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fa0b2cdd-597f-4d8e-a6f6-a204f01f2921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:28.026852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:28.133798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 215/394] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:28.150595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49f5c-e8b5-4ae1-a252-982cbe06940b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:28.177064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2cdd-597f-4d8e-a6f6-a204f01f2921 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:28.186063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:28.187021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:28.187312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:28.187641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:28.188838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:28.190273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:28.193224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 180/395] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:28 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:28.203844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:28.292426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:28.314345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252928-8ea7-4eea-b6fb-a964f78b7dcb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:28.320814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:28.337052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2cdd-597f-4d8e-a6f6-a204f01f2921 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:28.352303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:28.353306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:28.353597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:28.353877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3/groups/475e564ecab84be793c173a3bf52088b/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:28.355989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] RBAC: Authorizing `identity:create_grant(project_id=e156cfe62c864df8a73d802d59ef75a3, group_id=475e564ecab84be793c173a3bf52088b, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:28.357436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:28.381440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 181/396] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Jun 20 18:33:28 2022] PUT /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3/groups/475e564ecab84be793c173a3bf52088b/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:28.393363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:28.394216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:28.394499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:28.394855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:28.407580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:28.417171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:28.419426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:28.420595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 216/397] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:28.427690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:28.560708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c803d-7d5d-4b2f-b63e-8965ee2ccc5b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:28.594982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:28.595696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:28.595966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:28.596239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:28.596994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:28.597305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:28.598721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:28.607533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 182/398] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:28.612650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:28.742637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3a970-3295-4f63-ae9a-f958324c4c49 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:28.789307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:28.790193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:28.790483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:28.790769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:28.795627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:28.797088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:28.799042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 217/399] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:28 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:28.805070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:28.809000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:28.928929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd433-b2fb-44e3-a4e2-e16073f80506 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:28.962968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af064424-333a-4af1-a0e6-a7a6db3b43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:28.963984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064424-333a-4af1-a0e6-a7a6db3b43b9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:28.964322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064424-333a-4af1-a0e6-a7a6db3b43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:28.964609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064424-333a-4af1-a0e6-a7a6db3b43b9 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:28.965800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af064424-333a-4af1-a0e6-a7a6db3b43b9 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:28.967255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af064424-333a-4af1-a0e6-a7a6db3b43b9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:28.969303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 183/400] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:28 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:28.975437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:29.014980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:29.120997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0cd53-0cd6-4a0b-9442-d11fda3c8b8a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:29.162640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d19aba-6834-413f-91a7-e0788929a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:29.163579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19aba-6834-413f-91a7-e0788929a9f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.163869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19aba-6834-413f-91a7-e0788929a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.164151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19aba-6834-413f-91a7-e0788929a9f9 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5/groups/475e564ecab84be793c173a3bf52088b/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.171698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d19aba-6834-413f-91a7-e0788929a9f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=33de371567f9414098226ad9427441e5, group_id=475e564ecab84be793c173a3bf52088b, role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:29.173170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d19aba-6834-413f-91a7-e0788929a9f9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:29.199641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 218/401] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Jun 20 18:33:28 2022] PUT /identity/v3/projects/33de371567f9414098226ad9427441e5/groups/475e564ecab84be793c173a3bf52088b/roles/c9b4590007f942458d155393f4a0da83 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:29.214424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266794b4-b4e9-4f05-a8be-fa043359aed7 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.215021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266794b4-b4e9-4f05-a8be-fa043359aed7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.215482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266794b4-b4e9-4f05-a8be-fa043359aed7 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.217499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 184/402] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:29.222952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267b01-199e-48b8-aa4b-5190dadd4e5f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.223329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267b01-199e-48b8-aa4b-5190dadd4e5f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.223621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267b01-199e-48b8-aa4b-5190dadd4e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.250746 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-c5267b01-199e-48b8-aa4b-5190dadd4e5f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:29.252020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c5267b01-199e-48b8-aa4b-5190dadd4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:29.349073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 219/403] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:29.376551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266794b4-b4e9-4f05-a8be-fa043359aed7 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:29.457182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:29.494351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266794b4-b4e9-4f05-a8be-fa043359aed7 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:29.529788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c2f2e-602e-4cb8-b132-62cd7198cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:29.530610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2f2e-602e-4cb8-b132-62cd7198cbbe None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.530901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2f2e-602e-4cb8-b132-62cd7198cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.531459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2f2e-602e-4cb8-b132-62cd7198cbbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.542351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c2f2e-602e-4cb8-b132-62cd7198cbbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-610c2f2e-602e-4cb8-b132-62cd7198cbbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:29.550768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:29.551844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:29.552655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 185/404] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:29.558345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267b01-199e-48b8-aa4b-5190dadd4e5f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:29.579272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:29.639004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b0bd-f00b-4b3c-8210-d039c1a4c42c None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.639624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b0bd-f00b-4b3c-8210-d039c1a4c42c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.640106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b0bd-f00b-4b3c-8210-d039c1a4c42c None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.641907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 186/405] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:29.648941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778dcd-975e-4db3-9756-e1cbe54ba187 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.649494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778dcd-975e-4db3-9756-e1cbe54ba187 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.650002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778dcd-975e-4db3-9756-e1cbe54ba187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.685934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4d778dcd-975e-4db3-9756-e1cbe54ba187 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:29.687166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4d778dcd-975e-4db3-9756-e1cbe54ba187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:29.725582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267b01-199e-48b8-aa4b-5190dadd4e5f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:29.781922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:29.783006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.783507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.783994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.784988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:29.785495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:29.787363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:29.807156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 220/406] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:29.811017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:29.834263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 187/407] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:29.835771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a6d2-5922-4d21-857f-bb01e2b6efb0 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.836063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a6d2-5922-4d21-857f-bb01e2b6efb0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.836342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a6d2-5922-4d21-857f-bb01e2b6efb0 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.841545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 188/408] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:29.843118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d831a-0328-4425-8723-6e1534574f9b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.843409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d831a-0328-4425-8723-6e1534574f9b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.843686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d831a-0328-4425-8723-6e1534574f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:29.861574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b60d831a-0328-4425-8723-6e1534574f9b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:29.863087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b60d831a-0328-4425-8723-6e1534574f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:29.923305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:29.925515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:29.937804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5768be5-5a0c-4109-8750-9674eec9a40d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:29.938864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 189/409] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:29.943759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d831a-0328-4425-8723-6e1534574f9b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:29.997613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:29.998737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:29.999055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:29.999811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.001234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.003369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:30.006022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 221/410] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:29 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:30.007413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.056752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d831a-0328-4425-8723-6e1534574f9b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.093397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.094403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.094790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.095212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.106029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:30.114755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:30.116274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:30.118026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 190/411] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:30.119654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.141904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041db2a-fea5-4c20-9288-a079e4cb00c9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.177951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:30.190164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.191006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.191294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.191745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.206245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:30.216919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:30.218659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 222/412] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:30.220390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.226864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:30.236017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b7564-1aa0-47f4-ac23-249e58e4cc64 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.272779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.273731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.274118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.274499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.275832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.277493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:30.279623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 191/413] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:30 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:30.280544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.356462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4954f-5b5e-40b0-bfe4-39e6c6fb4041 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.392252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c30d-384e-46e0-81c1-25d2a41c68cd None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.400518 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.401315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.401702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.402083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.402965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:30.403389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.404835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:30.414591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 223/414] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:30.415561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.416144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:30.435257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.436472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.436923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.437355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.438991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:30.439478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.441033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:30.459707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 192/415] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:30.459707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.494890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:30.552819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3825ef-79b4-4ea4-8d95-dbc0ad8be63e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.591069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955fdb-19b1-49eb-ac24-6d657e7b3ee2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.601587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.603041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.603737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.604148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3/groups/475e564ecab84be793c173a3bf52088b/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.607539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e156cfe62c864df8a73d802d59ef75a3, group_id=475e564ecab84be793c173a3bf52088b, role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.609866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:30.627830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 224/416] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Jun 20 18:33:30 2022] PUT /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3/groups/475e564ecab84be793c173a3bf52088b/roles/c9b4590007f942458d155393f4a0da83 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:30.628826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.629029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.629794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.630161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.630452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] PATH_INFO: `/v3/groups/d1ebfa68ac314252ab55d1a45c41a13f` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.631863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] RBAC: Authorizing `identity:get_group(group_id=d1ebfa68ac314252ab55d1a45c41a13f)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.633520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:30.640524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 193/417] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:30 2022] GET /identity/v3/groups/d1ebfa68ac314252ab55d1a45c41a13f => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:30.641509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.762689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:30.818500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d08cb-0f6b-44cc-b5bd-ddcf476e09f4 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.838010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc56069-4a21-42ab-8c9b-cdb17f10f33c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:30.849267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:30.864039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed086295-fd34-4403-bb9b-90af2c78d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.864727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed086295-fd34-4403-bb9b-90af2c78d0aa None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.865025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed086295-fd34-4403-bb9b-90af2c78d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.865715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed086295-fd34-4403-bb9b-90af2c78d0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.878657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:30.879972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:30.881160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:30.881682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] PATH_INFO: `/v3/projects/a0b525758c904932afef5b70ff9bce58` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:30.884184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] RBAC: Authorizing `identity:get_project(project_id=a0b525758c904932afef5b70ff9bce58)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.885850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:30.888235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 194/418] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:30 2022] GET /identity/v3/projects/a0b525758c904932afef5b70ff9bce58 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:30.893853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:30.978486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed086295-fd34-4403-bb9b-90af2c78d0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:30.981460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed086295-fd34-4403-bb9b-90af2c78d0aa None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:31.074390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc22d3-b56c-44d6-84c4-07e84064b43b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:31.098274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:31.108150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 225/419] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:31.110259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2511a35-dc61-46de-a26f-9f931fbd2be4 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.110869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2511a35-dc61-46de-a26f-9f931fbd2be4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.111370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2511a35-dc61-46de-a26f-9f931fbd2be4 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.113450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 226/420] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:31.114525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2511a35-dc61-46de-a26f-9f931fbd2be4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:31.123911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92364-1bec-4d68-98f8-0313bd22468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:31.125339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92364-1bec-4d68-98f8-0313bd22468d None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.125635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92364-1bec-4d68-98f8-0313bd22468d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.125921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92364-1bec-4d68-98f8-0313bd22468d None admin] PATH_INFO: `/v3/projects/a0b525758c904932afef5b70ff9bce58/groups/d1ebfa68ac314252ab55d1a45c41a13f/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.128446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92364-1bec-4d68-98f8-0313bd22468d None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b525758c904932afef5b70ff9bce58, group_id=d1ebfa68ac314252ab55d1a45c41a13f, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:31.131215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92364-1bec-4d68-98f8-0313bd22468d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:31.146075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:31.155011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 195/421] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Jun 20 18:33:30 2022] PUT /identity/v3/projects/a0b525758c904932afef5b70ff9bce58/groups/d1ebfa68ac314252ab55d1a45c41a13f/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:31.157324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751cf7-66cd-443c-88f8-2e5b8c4e9edf None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.157892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751cf7-66cd-443c-88f8-2e5b8c4e9edf None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.158430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751cf7-66cd-443c-88f8-2e5b8c4e9edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.196462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-18751cf7-66cd-443c-88f8-2e5b8c4e9edf None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:31.200096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-18751cf7-66cd-443c-88f8-2e5b8c4e9edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:31.308581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2511a35-dc61-46de-a26f-9f931fbd2be4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:31.340011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 196/422] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:31.358951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:31.360157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.360679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.361213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.362608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:31.364928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:31.367272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 227/423] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:31 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:31.370217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18751cf7-66cd-443c-88f8-2e5b8c4e9edf None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:31.373005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:31.479418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:31.497366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a980a7-aa54-4e6d-820b-5004a8c7d1f5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:31.501432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18751cf7-66cd-443c-88f8-2e5b8c4e9edf None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:31.512028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:31.545796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:31.552456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.552742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.553022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.558938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:31.558938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:31.558938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 228/424] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:31 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:31.563598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:31.565683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dbc28-35d5-4c04-b084-f67c290e1847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:31.567500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dbc28-35d5-4c04-b084-f67c290e1847 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.568844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dbc28-35d5-4c04-b084-f67c290e1847 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.569314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dbc28-35d5-4c04-b084-f67c290e1847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.590355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dbc28-35d5-4c04-b084-f67c290e1847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-7e7dbc28-35d5-4c04-b084-f67c290e1847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:31.599479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:31.600577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 18:33:31.601551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:31.619223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 197/425] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:31.621111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075323d-e60c-4177-a6b9-c208ce58df4b None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.621509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075323d-e60c-4177-a6b9-c208ce58df4b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.621922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075323d-e60c-4177-a6b9-c208ce58df4b None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.623468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 198/426] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:31.628812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d10f4-970a-41df-bde3-9ecc29ba4b7c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.628812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d10f4-970a-41df-bde3-9ecc29ba4b7c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.629035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d10f4-970a-41df-bde3-9ecc29ba4b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.647590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5e4d10f4-970a-41df-bde3-9ecc29ba4b7c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:31.648963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5e4d10f4-970a-41df-bde3-9ecc29ba4b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:31.713590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07dd8c-e173-499c-8679-90bb866df1a0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:31.733257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 199/427] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:31.734507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d10f4-970a-41df-bde3-9ecc29ba4b7c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:31.767100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:31.767773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.768063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.768455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.769305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=33de371567f9414098226ad9427441e5) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:31.769623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:31.771273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:31.778161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 229/428] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:31 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=33de371567f9414098226ad9427441e5&role.id=a73d3b84962843cdb2898ec86046e88e => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:31.779246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:31.810660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:31.866005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:31.870450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d10f4-970a-41df-bde3-9ecc29ba4b7c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:31.935876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:31.936580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:31.936869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:31.937155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:31.937924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] RBAC: Adding query filter params (name=member) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:31.938238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:31.939654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:31.952485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 200/429] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:33:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:31.958332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:31.974690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bf9f6-2af6-4890-a9e6-b4a40918652c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.027435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.028283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.028569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.028850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.043680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:32.052904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:32.053834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:32.054643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 230/430] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:32.059733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:32.073429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221397b-b8f7-40ad-86dd-58d541b3b852 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.122277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.123452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.124040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.124536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.164771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:32.168491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:32.189191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c422c-eece-4b9f-b05e-3876b240abe2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.219830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:32.221312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:32.232945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.234361 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.235102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.235558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.236727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:32.237209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:32.239619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:32.250736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 231/431] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:32.256105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:32.341649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 201/432] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:32.347479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:32.378998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f732c3-a7e5-4dc3-98a7-fa125e324b3c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.420643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:32.425742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.426523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.426883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.427275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.448780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:32.469053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc650f78-b869-43cd-b29c-fc6a2f84715a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.510886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.512101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.512620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.513104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.514790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:32.516668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:32.517782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:32.521580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:32.522271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 202/433] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:32 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:32.525739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:32.643252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1f45a-243e-4fe7-90b0-ef87d2a83459 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.644074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 232/434] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:32.651368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:32.699276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:32.706557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.708177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.708575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.708984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.710930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:32.712611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:32.716174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 203/435] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:32 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:32.721899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:32.722651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:32.792043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888a1b-d0ea-4c44-8001-d2b2ebeed1d3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.839254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062887a3-cf92-4410-9219-91125ac7862d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:32.841333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.843111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.843404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.843688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] PATH_INFO: `/v3/projects/33de371567f9414098226ad9427441e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.844892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] RBAC: Authorizing `identity:get_project(project_id=33de371567f9414098226ad9427441e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:32.846345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:32.848920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 233/436] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:32 2022] GET /identity/v3/projects/33de371567f9414098226ad9427441e5 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:32.854754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:32.890238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:32.891184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:32.891479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:32.892171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:32.893339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=a73d3b84962843cdb2898ec86046e88e, scope.project.id=e156cfe62c864df8a73d802d59ef75a3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:32.893606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:32.895376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:32.903771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 204/437] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:32 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=a73d3b84962843cdb2898ec86046e88e => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:32.986072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcc15-c88d-4da1-b598-fb2c1f408f60 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:33.003138 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:33.026866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721a3ed-b536-4981-94cb-476ce9aa4d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:33.027826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a3ed-b536-4981-94cb-476ce9aa4d5a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.028143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a3ed-b536-4981-94cb-476ce9aa4d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.028431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a3ed-b536-4981-94cb-476ce9aa4d5a None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.029693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a3ed-b536-4981-94cb-476ce9aa4d5a None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:33.031554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a3ed-b536-4981-94cb-476ce9aa4d5a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:33.038654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 234/438] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:32 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:33.039640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.070412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4250-40c9-421c-a742-e77ddb93943b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.070752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4250-40c9-421c-a742-e77ddb93943b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.071091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc4250-40c9-421c-a742-e77ddb93943b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.072619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 235/439] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:33:33.077632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325902f6-7b89-4a2f-9663-0e28209a0760 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.077927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325902f6-7b89-4a2f-9663-0e28209a0760 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.078213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325902f6-7b89-4a2f-9663-0e28209a0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.098989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-325902f6-7b89-4a2f-9663-0e28209a0760 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:33.100190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-325902f6-7b89-4a2f-9663-0e28209a0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:33.113218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:33.167795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336386-f90f-41c9-8f3e-ea4f09a2b80d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:33.187829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 236/440] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:33.205360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:33.206030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.206321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.206604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.207527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=33de371567f9414098226ad9427441e5) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:33.207846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:33.209274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:33.211478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325902f6-7b89-4a2f-9663-0e28209a0760 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.215610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 205/441] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=33de371567f9414098226ad9427441e5&role.id=c9b4590007f942458d155393f4a0da83 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:33.323207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325902f6-7b89-4a2f-9663-0e28209a0760 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:33.338383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:33.362663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18b4bf-9466-4317-85ea-650e6eb6430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:33.364400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b4bf-9466-4317-85ea-650e6eb6430a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.364834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b4bf-9466-4317-85ea-650e6eb6430a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.365254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b4bf-9466-4317-85ea-650e6eb6430a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.377205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18b4bf-9466-4317-85ea-650e6eb6430a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-9b18b4bf-9466-4317-85ea-650e6eb6430a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:33.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:33.387241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:33.388086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 237/442] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:33.393270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.471216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aac64-f275-44b3-86e2-c657b47096cb None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.471433 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aac64-f275-44b3-86e2-c657b47096cb None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.471718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aac64-f275-44b3-86e2-c657b47096cb None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.473126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 238/443] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:33:33.478519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a361f-84e3-40b4-84e7-27adc814bfb2 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.478812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a361f-84e3-40b4-84e7-27adc814bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.479135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a361f-84e3-40b4-84e7-27adc814bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.497488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-392a361f-84e3-40b4-84e7-27adc814bfb2 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:33.498697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-392a361f-84e3-40b4-84e7-27adc814bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:33.516296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bebcc-3425-4bab-818b-3064df384005 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:33.542430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:33.560022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:33.560707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.560994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.561274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.562021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:33.562719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:33.563821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:33.573529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 206/444] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:33.579455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.584045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 239/445] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:33.606824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a361f-84e3-40b4-84e7-27adc814bfb2 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.691090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ad2e6-9b03-4f7d-9db1-0030ca83d3a2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:33.730704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a361f-84e3-40b4-84e7-27adc814bfb2 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:33.732462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:33.735446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:33.736120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.736410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.736699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.769017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:33.769837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.770135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.770420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.780548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:33.788866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:33.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:33.790588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 240/446] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:33.793459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:33.796148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.809301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:33.810773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:33.894014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f2227-dc0f-4fa5-a4de-103ccf27ad75 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:33.909280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 207/447] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:33.914861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.926992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:33.927665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:33.927954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:33.928234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:33.928988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:33.929585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:33.930678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:33.938539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 241/448] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:33.944443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:33.968536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:33.998072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:34.012845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d57608-6fab-47eb-a051-39a45f6c0166 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:34.042486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c94f9-9f95-42aa-86e3-8348cd7bbc38 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:34.045948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:34.046817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:34.047137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:34.047431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] PATH_INFO: `/v3/projects/e156cfe62c864df8a73d802d59ef75a3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:34.048620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] RBAC: Authorizing `identity:get_project(project_id=e156cfe62c864df8a73d802d59ef75a3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:34.050085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:34.052362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 208/449] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/projects/e156cfe62c864df8a73d802d59ef75a3 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:34.057722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:34.075267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:34.075920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:34.076212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:34.076498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:34.142512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:34.144007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:34.153561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4baec3-c8ad-4d0f-a7d8-43ec3aae768e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:34.167839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:34.188201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:34.189064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:34.189358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:34.189639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] PATH_INFO: `/v3/groups/475e564ecab84be793c173a3bf52088b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:34.190804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] RBAC: Authorizing `identity:get_group(group_id=475e564ecab84be793c173a3bf52088b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:34.192296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:34.193903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 209/450] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:34 2022] GET /identity/v3/groups/475e564ecab84be793c173a3bf52088b => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:34.199594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:34.222741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:34.244580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 242/451] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 18:33:34.250181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:34.300267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66f2a-1554-47bf-a7df-31dd5957f585 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:34.333687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:34.334361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:34.334652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:34.334951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:34.335792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] RBAC: Adding query filter params (group.id=475e564ecab84be793c173a3bf52088b, role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=e156cfe62c864df8a73d802d59ef75a3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:34.336181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:34.337628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:34.343337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 210/452] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:34 2022] GET /identity/v3/role_assignments?group.id=475e564ecab84be793c173a3bf52088b&scope.project.id=e156cfe62c864df8a73d802d59ef75a3&role.id=c9b4590007f942458d155393f4a0da83 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:34.349913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ae1b8-c7bd-4d2a-9f91-d604360495c7 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:34.378747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:34.390311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:34.391246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:34.391538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:34.391822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] PATH_INFO: `/v3/projects/a0b525758c904932afef5b70ff9bce58` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:34.393124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b525758c904932afef5b70ff9bce58)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:34.394619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:34.396976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 243/453] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:33:34 2022] GET /identity/v3/projects/a0b525758c904932afef5b70ff9bce58 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:34.402712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:34.493830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:34.509114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2969-128e-4aac-ace9-06669eaaa198 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:34.542844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c5351-919c-46bf-bec9-f1f52a109d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:34.543754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5351-919c-46bf-bec9-f1f52a109d02 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:34.544033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5351-919c-46bf-bec9-f1f52a109d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:34.544308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5351-919c-46bf-bec9-f1f52a109d02 None admin] PATH_INFO: `/v3/groups/d1ebfa68ac314252ab55d1a45c41a13f` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:34.545498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c5351-919c-46bf-bec9-f1f52a109d02 None admin] RBAC: Authorizing `identity:get_group(group_id=d1ebfa68ac314252ab55d1a45c41a13f)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:34.546948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c5351-919c-46bf-bec9-f1f52a109d02 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:34.548576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 211/454] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Jun 20 18:33:34 2022] GET /identity/v3/groups/d1ebfa68ac314252ab55d1a45c41a13f => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:34.554489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:34.654825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a4bcf-6a3e-4e32-99ab-6e18c3426a36 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:34.689197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345c91-2f98-44dc-8fc3-3cfc3ca05657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:34.689865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345c91-2f98-44dc-8fc3-3cfc3ca05657 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:34.690151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345c91-2f98-44dc-8fc3-3cfc3ca05657 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:34.690429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345c91-2f98-44dc-8fc3-3cfc3ca05657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:34.691288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345c91-2f98-44dc-8fc3-3cfc3ca05657 None admin] RBAC: Adding query filter params (group.id=d1ebfa68ac314252ab55d1a45c41a13f, role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=a0b525758c904932afef5b70ff9bce58) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:34.691603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345c91-2f98-44dc-8fc3-3cfc3ca05657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:34.693047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345c91-2f98-44dc-8fc3-3cfc3ca05657 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:34.698904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 244/455] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Jun 20 18:33:34 2022] GET /identity/v3/role_assignments?group.id=d1ebfa68ac314252ab55d1a45c41a13f&scope.project.id=a0b525758c904932afef5b70ff9bce58&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:37.053813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defe10-3f00-4501-b0f7-6e66e0921cad None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.054362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defe10-3f00-4501-b0f7-6e66e0921cad None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.054362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defe10-3f00-4501-b0f7-6e66e0921cad None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.056046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 212/456] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:37.061691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83feb2-6def-4998-8beb-0d439d1be636 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.062087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83feb2-6def-4998-8beb-0d439d1be636 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.062267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83feb2-6def-4998-8beb-0d439d1be636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.082780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ec83feb2-6def-4998-8beb-0d439d1be636 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:37.083991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ec83feb2-6def-4998-8beb-0d439d1be636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:37.157522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:37.181308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 245/457] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:37.221189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43defe10-3f00-4501-b0f7-6e66e0921cad None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:37.352071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43defe10-3f00-4501-b0f7-6e66e0921cad None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:37.356964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42083053-f523-4983-a070-f496de1a723d None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.357262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42083053-f523-4983-a070-f496de1a723d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.357554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42083053-f523-4983-a070-f496de1a723d None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.358959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 246/458] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:37.374223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8d3d-33e4-4232-9f3f-c8bbd6cdad2d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.374526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8d3d-33e4-4232-9f3f-c8bbd6cdad2d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.374812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8d3d-33e4-4232-9f3f-c8bbd6cdad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.392483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8cbe8d3d-33e4-4232-9f3f-c8bbd6cdad2d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:37.393880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8cbe8d3d-33e4-4232-9f3f-c8bbd6cdad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:37.394899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e657d-d129-47c4-9499-88e6b2277b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:37.395738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e657d-d129-47c4-9499-88e6b2277b56 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.396032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e657d-d129-47c4-9499-88e6b2277b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.396318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e657d-d129-47c4-9499-88e6b2277b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.410504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e657d-d129-47c4-9499-88e6b2277b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:37.412364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e657d-d129-47c4-9499-88e6b2277b56 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-e15e657d-d129-47c4-9499-88e6b2277b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:37.434690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:37.435618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 213/459] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e54c9-6ea4-45fb-a49c-c13e9f1823de None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e54c9-6ea4-45fb-a49c-c13e9f1823de None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e54c9-6ea4-45fb-a49c-c13e9f1823de None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.440242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 214/460] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:37.445785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e54c9-6ea4-45fb-a49c-c13e9f1823de None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:37.458420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:37.487027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 247/461] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:37.489525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc25-470d-4b18-847b-d088c18d000b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.490023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc25-470d-4b18-847b-d088c18d000b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.490506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc25-470d-4b18-847b-d088c18d000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.513073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fc84bc25-470d-4b18-847b-d088c18d000b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:37.514577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fc84bc25-470d-4b18-847b-d088c18d000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:37.575992 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e54c9-6ea4-45fb-a49c-c13e9f1823de None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:37.598946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 248/462] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:37.598946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84bc25-470d-4b18-847b-d088c18d000b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:37.631664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:37.632758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.633249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.633731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.634784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:37.635478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:37.637160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:37.649538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:37.652929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 215/463] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:37.653963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:37.720030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84bc25-470d-4b18-847b-d088c18d000b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:37.739789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:37.761631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:37.762825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.763329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.763875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.775164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:37.777187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:37.782806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6798-6f84-49ef-9e0f-db8d1c6d5d03 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:37.799503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:37.800385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:37.801877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:37.801877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:37.801877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:37.801877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:37.804247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 249/464] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:37.805323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:37.823430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:37.824261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.824558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.824841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.838791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:37.840957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:37.866500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:37.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:37.868318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:37.868318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:37.868318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:37.868318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:37.868318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 216/465] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:37.868580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:37.919684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:37.924257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd398b-a154-4338-8f10-dd022c777469 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:37.963722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:37.964758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:37.965269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:37.965751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:37.966741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:37.968576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:37.998590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4ad7d-f6df-4619-b57b-582fb582ff8c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:38.002813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 250/466] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:37 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:38.003988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:38.045054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:38.089870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae3c7b-1bbc-4709-8a1a-26863ac56cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:38.091443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3c7b-1bbc-4709-8a1a-26863ac56cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.091939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3c7b-1bbc-4709-8a1a-26863ac56cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.092425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3c7b-1bbc-4709-8a1a-26863ac56cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.093475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3c7b-1bbc-4709-8a1a-26863ac56cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:38.093890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3c7b-1bbc-4709-8a1a-26863ac56cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:38.095458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3c7b-1bbc-4709-8a1a-26863ac56cb3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:38.109341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 217/467] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:38.110953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645d92-c75e-4d68-854a-84b0449ce530 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.111354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645d92-c75e-4d68-854a-84b0449ce530 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.111738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645d92-c75e-4d68-854a-84b0449ce530 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.117678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 218/468] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:38.117678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a645d92-c75e-4d68-854a-84b0449ce530 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:38.169489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09039411-f3fa-407e-98b7-6665e67786e7 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:38.214874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270c99d-3ad9-4215-8b84-ec088b2e0c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:38.215614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c99d-3ad9-4215-8b84-ec088b2e0c60 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.215903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c99d-3ad9-4215-8b84-ec088b2e0c60 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.216310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270c99d-3ad9-4215-8b84-ec088b2e0c60 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.217037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270c99d-3ad9-4215-8b84-ec088b2e0c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:38.217348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270c99d-3ad9-4215-8b84-ec088b2e0c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:38.218749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270c99d-3ad9-4215-8b84-ec088b2e0c60 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:38.237954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a645d92-c75e-4d68-854a-84b0449ce530 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:38.240515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 251/469] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:38.241951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516f9b-623e-485a-b327-124bb363eb77 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.242250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516f9b-623e-485a-b327-124bb363eb77 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.242535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516f9b-623e-485a-b327-124bb363eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.263233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-dd516f9b-623e-485a-b327-124bb363eb77 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:38.264438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-dd516f9b-623e-485a-b327-124bb363eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:38.276780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:38.282642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:38.283370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.283659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.283947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.284679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:38.286991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:38.308785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 219/470] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:38 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:38.309670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:38.350941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 252/471] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:38.381478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:38.409952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516f9b-623e-485a-b327-124bb363eb77 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:38.493442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017a66-2a9e-449e-98d2-64656af30c67 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:38.533714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7ccd-35e9-47aa-b193-9e2ac4edb5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:38.534795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7ccd-35e9-47aa-b193-9e2ac4edb5d5 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.535323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7ccd-35e9-47aa-b193-9e2ac4edb5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.536317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7ccd-35e9-47aa-b193-9e2ac4edb5d5 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.537309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d7ccd-35e9-47aa-b193-9e2ac4edb5d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:38.539229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d7ccd-35e9-47aa-b193-9e2ac4edb5d5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:38.564728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516f9b-623e-485a-b327-124bb363eb77 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:38.568121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 220/472] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:38 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:38.601678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aaa4c-ffd7-4065-bb58-9cb1ac207448 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.602336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aaa4c-ffd7-4065-bb58-9cb1ac207448 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.602691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aaa4c-ffd7-4065-bb58-9cb1ac207448 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.603618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:38.604252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 221/473] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:38.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.604711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.605002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.611121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbae6-a8ab-4022-828d-8226b920512a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.611752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbae6-a8ab-4022-828d-8226b920512a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.612233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbae6-a8ab-4022-828d-8226b920512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.618261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:38.619989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:38.626702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:38.634110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1abdbae6-a8ab-4022-828d-8226b920512a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:38.636045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1abdbae6-a8ab-4022-828d-8226b920512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:38.646969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:38.648068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:38.649064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:38.649064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:38.649064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:38.649064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:38.651176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 253/474] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:38.661066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:38.755020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 222/475] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:38.774705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdbae6-a8ab-4022-828d-8226b920512a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:38.803198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:38.820458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb7325-d459-4170-bb0b-ca35653b9796 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:38.870836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:38.872126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.873199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.873672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.874830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:38.875578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:38.878032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:38.895916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 254/476] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:38.903363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:38.921711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdbae6-a8ab-4022-828d-8226b920512a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:38.961199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:38.962223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:38.962684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:38.963194 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:38.964151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:38.965708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:38.969336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:38.975187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.sql.core [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 18:33:38.975187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 18:33:38.975187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [parameters: {'id': '3bb39308274b4fdca073e2eb45ae4fb2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 18:33:38.975187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86914) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application conn.query(q) Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result.read() Jun 20 18:33:38.993155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 18:33:38.994096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application next(self.gen) Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application yield resource Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application next(self.gen) Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise self.value Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application session.commit() Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 18:33:38.995006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.session.flush() Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application compat.raise_( Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 18:33:38.995869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 18:33:38.996729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application conn.query(q) Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result.read() Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 18:33:38.997617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [parameters: {'id': '3bb39308274b4fdca073e2eb45ae4fb2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:38.998399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 18:33:39.000930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:39.004699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 223/477] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Jun 20 18:33:38 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:39.011586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:39.024316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7117d0-d5e6-4e82-956f-4e131f3a3be3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:39.061819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:39.062567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:39.062887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:39.063200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:39.064000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:39.065448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:39.088994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 255/478] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:38 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:33:39.109277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:39.131119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed256e-b7eb-4193-a4ed-7d1e0903f6bb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:39.179676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29836626-65bb-4e6c-83f1-0fc792b3932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:39.180914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836626-65bb-4e6c-83f1-0fc792b3932e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:39.181432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836626-65bb-4e6c-83f1-0fc792b3932e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:39.182016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836626-65bb-4e6c-83f1-0fc792b3932e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:39.201543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29836626-65bb-4e6c-83f1-0fc792b3932e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-29836626-65bb-4e6c-83f1-0fc792b3932e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:39.211199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:39.212203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 18:33:39.213038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:39.215904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 224/479] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:33:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:39.221879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:39.347513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcce43-77e7-40b3-a4db-98db8ffb5965 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:39.361049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:39.384635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15b69-ab74-4250-b148-c1fed4d59c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:39.385318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15b69-ab74-4250-b148-c1fed4d59c84 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:39.385608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15b69-ab74-4250-b148-c1fed4d59c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:39.385892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15b69-ab74-4250-b148-c1fed4d59c84 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:39.386657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f15b69-ab74-4250-b148-c1fed4d59c84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:39.386999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f15b69-ab74-4250-b148-c1fed4d59c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:39.388398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f15b69-ab74-4250-b148-c1fed4d59c84 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:39.398254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 256/480] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:40.467487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676e9ec-3825-48dd-aeda-024241d54fc7 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:40.468008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676e9ec-3825-48dd-aeda-024241d54fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:40.468346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676e9ec-3825-48dd-aeda-024241d54fc7 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:40.470049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 225/481] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:40.485642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c663-2b2f-4591-b1cf-ae575a85b224 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:40.486117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c663-2b2f-4591-b1cf-ae575a85b224 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:40.486267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c663-2b2f-4591-b1cf-ae575a85b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:40.503617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a133c663-2b2f-4591-b1cf-ae575a85b224 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:40.504895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a133c663-2b2f-4591-b1cf-ae575a85b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:40.613377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 257/482] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:40.649326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676e9ec-3825-48dd-aeda-024241d54fc7 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:40.770452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676e9ec-3825-48dd-aeda-024241d54fc7 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:40.810243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19674162-8220-4827-bd5d-cc6ba99948b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:40.811124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674162-8220-4827-bd5d-cc6ba99948b1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:40.811422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674162-8220-4827-bd5d-cc6ba99948b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:40.811704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674162-8220-4827-bd5d-cc6ba99948b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:40.823349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19674162-8220-4827-bd5d-cc6ba99948b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-19674162-8220-4827-bd5d-cc6ba99948b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:40.831368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:40.832292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:40.833085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 226/483] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:40.838683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133c663-2b2f-4591-b1cf-ae575a85b224 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:40.863748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f639ab-f765-44f1-a55d-74429f8c5075 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:40.864036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f639ab-f765-44f1-a55d-74429f8c5075 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:40.864461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f639ab-f765-44f1-a55d-74429f8c5075 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:40.866665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 227/484] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:40.871584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f41c1-fa5b-4bbb-8325-973ad9abb7bf None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:40.871959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f41c1-fa5b-4bbb-8325-973ad9abb7bf None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:40.872353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f41c1-fa5b-4bbb-8325-973ad9abb7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:40.879106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:40.894529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-616f41c1-fa5b-4bbb-8325-973ad9abb7bf None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:40.895771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-616f41c1-fa5b-4bbb-8325-973ad9abb7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:41.004599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 228/485] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:41.041792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133c663-2b2f-4591-b1cf-ae575a85b224 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.044406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:41.076727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f41c1-fa5b-4bbb-8325-973ad9abb7bf None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.083281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.083968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.084253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.084528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.085338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:41.085643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:41.087243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:41.095797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 258/486] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:41.101904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.216099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508d159-cdc1-4232-bf45-3a56b3a315ed None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.267961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f41c1-fa5b-4bbb-8325-973ad9abb7bf None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.287567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593a80-4361-412c-bc9e-1b8213421e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.288381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593a80-4361-412c-bc9e-1b8213421e82 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.288669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593a80-4361-412c-bc9e-1b8213421e82 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.288952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593a80-4361-412c-bc9e-1b8213421e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.312587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84593a80-4361-412c-bc9e-1b8213421e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:41.313994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84593a80-4361-412c-bc9e-1b8213421e82 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:41.335711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfcafa-4a09-4a97-b9de-014834824cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.336532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfcafa-4a09-4a97-b9de-014834824cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.336820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfcafa-4a09-4a97-b9de-014834824cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.337104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfcafa-4a09-4a97-b9de-014834824cd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.339007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-84593a80-4361-412c-bc9e-1b8213421e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:41.344006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:41.344874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:41.345768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:41.345768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:41.345768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:41.345768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:41.345768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 259/487] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:41.346941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e042-2855-44c0-aa40-a4c177994404 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.347252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e042-2855-44c0-aa40-a4c177994404 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.347540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e042-2855-44c0-aa40-a4c177994404 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.349599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfcafa-4a09-4a97-b9de-014834824cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:41.353641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 260/488] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:41.354419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510e042-2855-44c0-aa40-a4c177994404 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-05cfcafa-4a09-4a97-b9de-014834824cd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:41.357597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:41.358490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:41.359329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 229/489] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:41.360748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b3261-8370-4a6a-9737-fbbda0111d3f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.360748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b3261-8370-4a6a-9737-fbbda0111d3f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.360748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b3261-8370-4a6a-9737-fbbda0111d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.380322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:41.382276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-876b3261-8370-4a6a-9737-fbbda0111d3f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:41.384139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-876b3261-8370-4a6a-9737-fbbda0111d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:41.468304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 230/490] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:41.469171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b3261-8370-4a6a-9737-fbbda0111d3f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.507889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510e042-2855-44c0-aa40-a4c177994404 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.553632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.554320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.554608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.554892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.555661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:41.556476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:41.557883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:41.574750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 261/491] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:41.576207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.586066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b3261-8370-4a6a-9737-fbbda0111d3f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.619185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:41.634069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.634752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.635095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.635381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.636139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:41.636447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:41.637889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:41.651140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 231/492] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:41.652061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.681604 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:41.725889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ffe5-672d-4066-b057-8482276eba7a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.763674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.764450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.764742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.765027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.776015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ee126-27e3-4730-810a-0f02ab402064 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.780834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:41.788689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:41.789609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:41.790392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:41.794671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 262/493] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:41.795557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.820691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.821502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.821788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.822068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] PATH_INFO: `/v3/users/nova` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.829800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:41.831196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:41.847044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:41.848058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:33:41.848975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:41.852786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 232/494] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:41.853619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:41.904116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7296ac-d5ab-4354-bac3-e8a498372b9d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.912267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:41.941512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd962e10-ae51-4eca-b56e-d77e25347cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:41.942836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962e10-ae51-4eca-b56e-d77e25347cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.943156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962e10-ae51-4eca-b56e-d77e25347cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.943449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962e10-ae51-4eca-b56e-d77e25347cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.950130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:41.954909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd962e10-ae51-4eca-b56e-d77e25347cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:41.956790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd962e10-ae51-4eca-b56e-d77e25347cc6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:41.972801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2539129-ad29-4ac3-af79-8669efc38cee None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-fd962e10-ae51-4eca-b56e-d77e25347cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:41.974045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:41.974995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:41.975865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:41.975865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:41.975865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:41.975865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:41.975865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 263/495] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:41.976666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ad5c3-bc38-4a76-9f06-7c9b388fa7bd None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:41.976824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ad5c3-bc38-4a76-9f06-7c9b388fa7bd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:41.977118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ad5c3-bc38-4a76-9f06-7c9b388fa7bd None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:41.978493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 264/496] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:41.983045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ad5c3-bc38-4a76-9f06-7c9b388fa7bd None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.015030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.015708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.015993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.016279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.017022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:42.017331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.018701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.027224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 233/497] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:42.028018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.096571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ad5c3-bc38-4a76-9f06-7c9b388fa7bd None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.131793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d73c4c-85aa-4f6c-b8d6-862e54699b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.132920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73c4c-85aa-4f6c-b8d6-862e54699b1b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.133227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73c4c-85aa-4f6c-b8d6-862e54699b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.133655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73c4c-85aa-4f6c-b8d6-862e54699b1b None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.134518 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d73c4c-85aa-4f6c-b8d6-862e54699b1b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:42.134837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d73c4c-85aa-4f6c-b8d6-862e54699b1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.135373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc182c11-09bc-4b99-8f0a-c40d5553750f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.136335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d73c4c-85aa-4f6c-b8d6-862e54699b1b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.144772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.170725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.171439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.171726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.172002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.172723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:42.173029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.178424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 265/498] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:33:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:42.178554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.178630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018785b-ec69-490c-a2d4-947a5a75375f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.178630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018785b-ec69-490c-a2d4-947a5a75375f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.178630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018785b-ec69-490c-a2d4-947a5a75375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.190492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 234/499] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:42.192399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.196372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6018785b-ec69-490c-a2d4-947a5a75375f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:42.197569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6018785b-ec69-490c-a2d4-947a5a75375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:42.242504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.266099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 266/500] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:42.266961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018785b-ec69-490c-a2d4-947a5a75375f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.297002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccd10c-4d7e-484a-bc26-999507a5d342 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.330774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.331594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.331887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.332200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.341919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.343405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:42.360888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:42.361723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:42.362616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:42.362616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:42.362616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:42.362616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:42.362616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 235/501] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:42.362876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.369290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018785b-ec69-490c-a2d4-947a5a75375f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.384375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.403505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.404168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.404458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.404740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.451691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.467985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfad5-364e-4381-bd68-0644d0626125 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.474592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.476092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.502047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311620-ec7a-4aa2-bf03-e165dcde310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.502851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311620-ec7a-4aa2-bf03-e165dcde310f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.503168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311620-ec7a-4aa2-bf03-e165dcde310f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.503447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311620-ec7a-4aa2-bf03-e165dcde310f None admin] PATH_INFO: `/v3/users/glance` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.510293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311620-ec7a-4aa2-bf03-e165dcde310f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.511755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311620-ec7a-4aa2-bf03-e165dcde310f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6f311620-ec7a-4aa2-bf03-e165dcde310f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:42.526747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:42.527721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:42.528624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 236/502] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:42.529297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f489-fc3b-4a74-b70a-c6e75ae36c46 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.529595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f489-fc3b-4a74-b70a-c6e75ae36c46 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.529859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f489-fc3b-4a74-b70a-c6e75ae36c46 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.531558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 237/503] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:42.532158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1f489-fc3b-4a74-b70a-c6e75ae36c46 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.578481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 267/504] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:42.579310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.616143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.635991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1f489-fc3b-4a74-b70a-c6e75ae36c46 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.656782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.671399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.672231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.672532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.672815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.678520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ff0ab-f3dd-4c7d-849b-4bbd2e236969 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.682739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:42.690537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:42.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:42.692346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 238/505] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:42.693098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.715605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9ca28-4dba-4d68-9253-c736290276c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.716293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9ca28-4dba-4d68-9253-c736290276c6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.716762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9ca28-4dba-4d68-9253-c736290276c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.717055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9ca28-4dba-4d68-9253-c736290276c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.717789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9ca28-4dba-4d68-9253-c736290276c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:42.718151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9ca28-4dba-4d68-9253-c736290276c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.719614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9ca28-4dba-4d68-9253-c736290276c6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.731710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 268/506] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:42.732946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd523-5529-4a8d-9f7b-4b6dfff2f9a3 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.733245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd523-5529-4a8d-9f7b-4b6dfff2f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.733539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd523-5529-4a8d-9f7b-4b6dfff2f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.750159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0c4dd523-5529-4a8d-9f7b-4b6dfff2f9a3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:42.751407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0c4dd523-5529-4a8d-9f7b-4b6dfff2f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:42.791755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc417b95-254b-4f46-a260-a9b96bcf8969 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.817202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 269/507] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:42.817920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd523-5529-4a8d-9f7b-4b6dfff2f9a3 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.827788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.828475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.828768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.829052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.829902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:42.830218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.831821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.858934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.870766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 239/508] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:42.871562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:42.900983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:42.935209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd523-5529-4a8d-9f7b-4b6dfff2f9a3 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.968025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:42.968851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:42.969178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:42.969454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:42.969982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a185b8-85f5-4b5e-8a1e-9fa1a9c60fad None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:42.980584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:42.982028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:42.998874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:42.999933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:43.000959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:43.000959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:43.000959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:43.000959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:43.003412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.004608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.005058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.005163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 270/509] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:43.005259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.005753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.005920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:43.006232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.007651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.015762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 240/510] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:43.016543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.075169 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.108602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398687f-feda-4461-921d-ec7297bcdbb3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.115588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c51c-b4c2-446b-9ff4-2becb419eb3a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.127409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.142940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.143754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.144048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.144329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.149446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.150244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.150530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.150810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.152215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.153679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.161667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.163139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:43.169087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:43.170126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 271/511] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:43.171218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:43.183148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:43.184071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:43.185079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:43.185079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:43.185079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:43.185079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:43.185079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 241/512] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:43.185465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.273572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7c9ec-7396-41c6-ae19-67f709bb3a05 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.285506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4fe3-220e-4bbf-8bf4-f16c00be7ca5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.297828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.305917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.306568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.306856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.307166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.319793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.320453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.320742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.321024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.321748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:43.322055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.323459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.336867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 242/513] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:43.337660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.354789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.375317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.376782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.436467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae74a87-f60c-4d88-82e0-52a8a36dcde1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.469078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.469871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.470161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.470437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.474175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 272/514] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:43.475053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.482723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.484572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:43.502475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:43.503866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:43.505272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:43.505272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:43.505272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:43.505272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:43.505272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 243/515] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:43.505272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.530530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.555176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.574767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ceddf-501e-4df4-a2f6-c49c92a48b98 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.603342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb09e3-9091-4223-811c-52c870205f18 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.606425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.607149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.607417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.607696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.608525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:43.608861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.610310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.627277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 273/516] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:43.628056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.637002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.637674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.637964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.638248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.639002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:43.639316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.640685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.651783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 244/517] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:43.652557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.731863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ac24-192e-458c-937a-2d4bc7757834 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.739142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.755099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba491-a4dc-4356-9566-0fd89dd61ef1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.764695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.765487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.765769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.766042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.772509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.773977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.776032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.788648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.789447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.789733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.790009 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:43.790095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:43.791060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 274/518] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:43.792116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.803955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.805407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:43.822267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:43.823159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:43.824208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:43.824208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:43.824208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:43.824208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:43.824208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 245/519] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:43.824208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.891161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fcf8-d06a-4208-b747-15a382895cb4 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.922323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bb407-04b6-4e58-94a7-79600d0ab53f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:43.924210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.924882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.925172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.925456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.926725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:43.927067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:43.928436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:43.939761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 275/520] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:43.940698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:43.957852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:43.958509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:43.958799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:43.959136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:43.962449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:43.997135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.025902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.027403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.038609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5691-6154-4e3f-8457-fc42ca818110 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.072239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.072903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.073188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.073464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.074171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.075625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.095296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 276/521] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:33:43 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:33:44.096087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.129086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 246/522] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:44.132115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.171250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.220342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef6dd-ffb4-4165-834a-958035b681b0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.237221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.244553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7704e-3a77-46c9-9422-9540d8b540d5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.264512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.264512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.264939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.265146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.265957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:44.266271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.267762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.288841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.288841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.288841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.289167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.290527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 277/523] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:44.290646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:44.290646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.290770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.292408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.305272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 247/524] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:44.306181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.398554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea036e-4666-4538-9099-26069f3820b8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.409267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.416534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5d76d-d338-4d57-a41a-9bf0c3df5b9c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.443514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.444846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.445510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.445939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.451597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.452465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.452756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.453048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.456580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.459005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.465446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.466901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:44.478814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:44.479889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 18:33:44.480987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:44.482866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 278/525] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:44.483785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:44.485055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:44.485858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:44.486822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:44.486822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:44.486822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:44.486822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:44.490994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 248/526] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:44.491878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.528436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.596404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe88f4-09bf-46c2-91e6-b5bff09b2eab None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.606680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd38d29-f905-43fb-9f55-ff3a4e708757 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.632059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.633097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.633531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.633965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.640851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.641762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.642422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.642713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.642976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.643083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.643850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=87a7fb173c0e439290808a6f9e1616f2) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:44.644167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.646247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.652625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 279/527] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/role_assignments?user.id=87a7fb173c0e439290808a6f9e1616f2&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:44.653425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:44.660414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:44.661324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:44.662275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:44.664152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 249/528] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:44.665234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.677449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.775355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.780293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0924fb7-9478-4cb8-8464-771df55f810b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.798889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be53f2b-28c4-4cb1-947f-04ee2b19ab30 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.822609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.823560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.823956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.824341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.825334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:44.825764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.827398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.843720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:44.845411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:44.845995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:44.846521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:44.847459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:44.847958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:44.849036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 280/529] 10.222.0.43 () {56 vars in 1139 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:44.849957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:44.850224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.867049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 250/530] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:44.869652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:44.951233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:44.977916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddccab5-23c3-4735-9026-7549e6fc25f2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:44.988079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafa594-f26d-4741-8a66-dd35ee1b222f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:45.023431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.024355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.024772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.025155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.026071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.026894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.027348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.027761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.030852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:45.031623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.033234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.048914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 281/531] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:45.049933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.078707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:45.108372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.109832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.179411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:45.196938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124748-e967-43e0-ab98-e7617e9121c9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:45.227816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 251/532] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:45.227816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.242216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.243391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.243966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.244454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.252724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.254617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:45.270445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:45.271386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:45.272257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:45.274749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 282/533] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:45.275786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.356176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40da58e-86c3-41c6-9a96-54d4c117fd72 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:45.360696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:45.391261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcfda-0496-439e-8b6d-ce2d739363f8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:45.392764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.393732 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.394275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.395477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.396669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=880c7a0632ef44a1ab446d1bb53399fb) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:45.397194 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.398844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.411172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 252/534] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/role_assignments?user.id=880c7a0632ef44a1ab446d1bb53399fb&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:45.412471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.435229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.436113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.436408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.436689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.450620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.451916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:45.473535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:45.474475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:45.475357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:45.475357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:45.475357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:45.475357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:45.478373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 283/535] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:45.484919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.495306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:45.604626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d6a28-c66b-4fc8-8e8b-dfa3ecbfed44 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:45.636351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:45.647241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.648192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.648611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.649178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.650200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:45.650658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.652555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.671292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 284/536] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:45.672760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.683665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f9b5e-66c9-4963-9fc5-5e0e37ad3e21 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:45.729875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.731167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.731167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.731587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.732503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:45.732918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.735319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.782693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 253/537] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:45.790727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.807774 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41e26f-51dc-4749-8c8b-643cc7804feb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:45.849826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:45.851198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:45.851701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:45.852185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:45.861870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:45.863783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:45.880239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:45.881129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:45.882050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:45.884857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 285/538] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:45.891133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:45.955642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:45.983255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:45.999935 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3922b4-b646-4f6f-b386-c477cdc328de None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:46.005344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b19780-e267-4fdd-bd88-6171cefcfc10 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:46.041574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:46.042408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.042794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.043210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.044079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:46.051528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:46.051528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:46.063160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 286/539] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:46.065166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:46.072166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d7f87-d833-4b8e-be55-51f5f7d3f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:46.073022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7f87-d833-4b8e-be55-51f5f7d3f5cd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.073461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7f87-d833-4b8e-be55-51f5f7d3f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.073890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7f87-d833-4b8e-be55-51f5f7d3f5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.074897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d7f87-d833-4b8e-be55-51f5f7d3f5cd None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=7d62786b3a2b40a6aea979d7875d410b) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:46.075406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d7f87-d833-4b8e-be55-51f5f7d3f5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:46.076997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d7f87-d833-4b8e-be55-51f5f7d3f5cd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:46.088950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 254/540] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:45 2022] GET /identity/v3/role_assignments?user.id=7d62786b3a2b40a6aea979d7875d410b&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:46.234855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0787b9-c887-4cb0-b006-d3387a1fa478 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:46.248269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:46.280380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7002c-ad0e-4b8e-b5f7-bb2ae1c10363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:46.281062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7002c-ad0e-4b8e-b5f7-bb2ae1c10363 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.281605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7002c-ad0e-4b8e-b5f7-bb2ae1c10363 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.281894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7002c-ad0e-4b8e-b5f7-bb2ae1c10363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.282754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7002c-ad0e-4b8e-b5f7-bb2ae1c10363 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=b3d7fbf23c584c32a518abd0b5326229) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:46.283109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7002c-ad0e-4b8e-b5f7-bb2ae1c10363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:46.284573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7002c-ad0e-4b8e-b5f7-bb2ae1c10363 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:46.291908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 287/541] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:46 2022] GET /identity/v3/role_assignments?user.id=b3d7fbf23c584c32a518abd0b5326229&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:46.303495 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcfe94-0e3b-4d64-b5f8-7897affc6363 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.303791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcfe94-0e3b-4d64-b5f8-7897affc6363 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.304132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcfe94-0e3b-4d64-b5f8-7897affc6363 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.305811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 255/542] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:46.311519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651a87-4d07-4faa-a953-75feb1b6de49 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.311811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651a87-4d07-4faa-a953-75feb1b6de49 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.312107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651a87-4d07-4faa-a953-75feb1b6de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.339298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-23651a87-4d07-4faa-a953-75feb1b6de49 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:46.340612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-23651a87-4d07-4faa-a953-75feb1b6de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:46.446398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 288/543] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:46.483198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcfe94-0e3b-4d64-b5f8-7897affc6363 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:46.617680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcfe94-0e3b-4d64-b5f8-7897affc6363 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:46.664977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:46.665796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.666087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.666372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.683853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:46.691909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:46.692788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:46.693593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 256/544] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:46.698942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651a87-4d07-4faa-a953-75feb1b6de49 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:46.850368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651a87-4d07-4faa-a953-75feb1b6de49 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:46.851910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:46.887171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd617b-dd20-4ddd-8243-897c165e2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:46.887776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd617b-dd20-4ddd-8243-897c165e2912 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.888066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd617b-dd20-4ddd-8243-897c165e2912 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.888348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd617b-dd20-4ddd-8243-897c165e2912 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.889110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd617b-dd20-4ddd-8243-897c165e2912 None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:46.889422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd617b-dd20-4ddd-8243-897c165e2912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:46.890815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd617b-dd20-4ddd-8243-897c165e2912 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:46.900181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 289/545] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:46.905357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:46.940132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:46.962190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a5de-be77-475d-b9b0-84e30322675f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.962503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a5de-be77-475d-b9b0-84e30322675f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.962774 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a5de-be77-475d-b9b0-84e30322675f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.964540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 290/546] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:46.969844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52f33a-c250-4677-b962-62b3aff56063 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:46.970140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52f33a-c250-4677-b962-62b3aff56063 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:46.970426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52f33a-c250-4677-b962-62b3aff56063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:46.991462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9d52f33a-c250-4677-b962-62b3aff56063 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:46.992669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9d52f33a-c250-4677-b962-62b3aff56063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:47.053657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb11be0-bf77-40d2-ab4f-25a4971e16bd None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:47.090181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:47.091395 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:47.091908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:47.092407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:47.103458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:47.105358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:47.123294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:47.124147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:47.124981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:47.124981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:47.124981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:47.124981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:47.127258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 257/547] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:47.133257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 291/548] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 18:33:47.134293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.169720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52f33a-c250-4677-b962-62b3aff56063 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.218220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:47.255654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244833db-21c4-46ff-8aa1-a239aba70284 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:47.314708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:47.315761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:47.316268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:47.316820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:47.317754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:47.318258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:47.319851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:47.340285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 258/549] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:47.348472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.351277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:47.360838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52f33a-c250-4677-b962-62b3aff56063 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:47.414943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:47.415757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:47.416047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:47.416334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:47.435415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:47.447903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:47.449356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:47.450351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:47.454030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 292/550] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:47.460820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.529900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009144a-f9ea-432b-a879-1157954767e9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:47.580354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:47.588540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726ba1-77fa-46e5-b11c-d3bc656a91ba None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:47.593928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:47.594748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:47.595069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:47.595351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:47.612331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:47.613844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:47.622747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:47.623459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:47.623750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:47.624034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:47.624799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:47.625115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:47.626495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:47.635635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 293/551] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:47.636649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:47.637579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:33:47.638695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:47.641075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.644357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 259/552] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:47.650897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.687367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:47.793423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fcc4-6fc4-4fc5-b042-73bbb50d58a7 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:47.825219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738afff3-6580-4aa5-9471-6430bd617af2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:47.830201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:47.831304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:47.831834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:47.832880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:47.843853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:47.845612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:47.864528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:47.865451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:47.866395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:47.866395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:47.866395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:47.866395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:47.868640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 294/553] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:33:47.880360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.903632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:47.904336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:47.904633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:47.904924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:47.905785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:47.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:47.907849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:47.942216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 260/554] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:47.947946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:47.959881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:47.991043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e334-2f36-49aa-a401-26b26f616763 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.039827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.040563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.040864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.041153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.041891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:48.042209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:48.043287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:48.043626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:48.067285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 295/555] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:48.070564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.131728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36990fa6-a5eb-463e-b607-0cf55cb8990b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.193005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311e500-1cdd-4cc3-85b9-9c9b9627eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.194004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311e500-1cdd-4cc3-85b9-9c9b9627eea8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.194489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311e500-1cdd-4cc3-85b9-9c9b9627eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.194998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311e500-1cdd-4cc3-85b9-9c9b9627eea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.226814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e79899-661e-4332-9432-e7ea2f10d3e4 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.255227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:48.264033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce6a07-239f-41d4-8a20-48b4238ba0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.264907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce6a07-239f-41d4-8a20-48b4238ba0a5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.265203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce6a07-239f-41d4-8a20-48b4238ba0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.265544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce6a07-239f-41d4-8a20-48b4238ba0a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.271519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311e500-1cdd-4cc3-85b9-9c9b9627eea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:48.273467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce6a07-239f-41d4-8a20-48b4238ba0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:48.273756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311e500-1cdd-4cc3-85b9-9c9b9627eea8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:48.275066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce6a07-239f-41d4-8a20-48b4238ba0a5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-21ce6a07-239f-41d4-8a20-48b4238ba0a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:48.291864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:48.293373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:33:48.294301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:48.296875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 296/556] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:48.297974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73249a-049a-44f2-b54b-33c5f8489a4a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.298270 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73249a-049a-44f2-b54b-33c5f8489a4a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.298557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73249a-049a-44f2-b54b-33c5f8489a4a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.299982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 297/557] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:48.304525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73249a-049a-44f2-b54b-33c5f8489a4a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.334284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:48.390952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 261/558] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 18:33:48.392753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00687f-5491-47bc-9f3e-dc3fef7777eb None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.393262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00687f-5491-47bc-9f3e-dc3fef7777eb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.393749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00687f-5491-47bc-9f3e-dc3fef7777eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.411952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-0c00687f-5491-47bc-9f3e-dc3fef7777eb None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:48.413709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0c00687f-5491-47bc-9f3e-dc3fef7777eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:48.416654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73249a-049a-44f2-b54b-33c5f8489a4a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.453647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.454249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.454536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.454814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.455691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:48.456053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:48.457472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:48.476919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 298/559] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:48.477752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.500445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 262/560] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:48.501859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1203819-16f8-4f43-b44a-ed3294c1f36d None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.502160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1203819-16f8-4f43-b44a-ed3294c1f36d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.502440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1203819-16f8-4f43-b44a-ed3294c1f36d None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.504049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 263/561] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:48.508688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1203819-16f8-4f43-b44a-ed3294c1f36d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.542558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:48.595932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f15b24-4cf7-4cbd-9d14-8a73a677f348 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.596818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:48.624309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1203819-16f8-4f43-b44a-ed3294c1f36d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.630605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069d87-7c48-40d6-a84e-efff531565ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.631435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069d87-7c48-40d6-a84e-efff531565ae None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.631725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069d87-7c48-40d6-a84e-efff531565ae None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.632010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069d87-7c48-40d6-a84e-efff531565ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.641771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a069d87-7c48-40d6-a84e-efff531565ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:48.643310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a069d87-7c48-40d6-a84e-efff531565ae None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:48.661167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-3a069d87-7c48-40d6-a84e-efff531565ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:48.661736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:48.662593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:48.663527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:48.663527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:48.663527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:48.663527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:48.663527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 299/562] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:48.664148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a0dd-ab00-444c-9d2b-99e57486eea6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.664392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a0dd-ab00-444c-9d2b-99e57486eea6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.664675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a0dd-ab00-444c-9d2b-99e57486eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.665131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.665578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.666116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.678158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:48.679654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:48.682289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fc01a0dd-ab00-444c-9d2b-99e57486eea6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:48.683526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fc01a0dd-ab00-444c-9d2b-99e57486eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:48.698053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:48.699027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:48.704641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:48.704641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:48.704641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:48.704641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:48.704641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 264/563] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:48.704641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.766290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 300/564] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:48.767598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a0dd-ab00-444c-9d2b-99e57486eea6 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.807686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:48.819798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7061516-b48e-45c2-a14d-aa92ee476d2b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.847683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:48.856687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.857503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.857791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.858077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.868286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:48.876089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:48.876994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:48.877858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 265/565] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:48.878548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.885288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a0dd-ab00-444c-9d2b-99e57486eea6 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:48.919485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:48.920160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:48.920457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:48.920736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:48.921468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:48.921781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:48.923190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:48.934119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 301/566] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:48.934903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:48.980064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88ef7-3bb6-4a12-9127-9d93df9ee2af None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.012944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bfd0-da3a-4510-9353-16f91be0c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.013606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bfd0-da3a-4510-9353-16f91be0c008 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.013894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bfd0-da3a-4510-9353-16f91be0c008 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.014197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bfd0-da3a-4510-9353-16f91be0c008 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.014929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bfd0-da3a-4510-9353-16f91be0c008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:49.015249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bfd0-da3a-4510-9353-16f91be0c008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.016625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bfd0-da3a-4510-9353-16f91be0c008 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.022674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.028622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 266/567] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:49.029842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c144-8d34-4b7d-acb0-46d5965ed678 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.030129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c144-8d34-4b7d-acb0-46d5965ed678 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.030406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c144-8d34-4b7d-acb0-46d5965ed678 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.032057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 267/568] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:49.032583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c144-8d34-4b7d-acb0-46d5965ed678 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.040221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad90e-1dfc-4028-abc7-433eeb936c15 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.075277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.076083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.076372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.076655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.080462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.087866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:49.096078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:49.097098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:49.097952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 302/569] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:49.099030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.133697 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c144-8d34-4b7d-acb0-46d5965ed678 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.167445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.168117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.168406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.168686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.169437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:49.169751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.171143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.178933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 268/570] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:49.179715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.200891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06567270-7201-402a-930f-1e22e748c9f1 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.234343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec089-7458-45a0-abd5-b0ffde35cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.235166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec089-7458-45a0-abd5-b0ffde35cce1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.235460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec089-7458-45a0-abd5-b0ffde35cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.235746 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec089-7458-45a0-abd5-b0ffde35cce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.242190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec089-7458-45a0-abd5-b0ffde35cce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.243664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec089-7458-45a0-abd5-b0ffde35cce1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-f59ec089-7458-45a0-abd5-b0ffde35cce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:49.260723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:49.261631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:49.262799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 303/571] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:49.263490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da8f33-9ad4-4183-9034-97e706a325e6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.263490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da8f33-9ad4-4183-9034-97e706a325e6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.263620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da8f33-9ad4-4183-9034-97e706a325e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.278797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950b15-dbfa-4a44-beff-6b921c2ddd84 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.279565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-68da8f33-9ad4-4183-9034-97e706a325e6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:49.280745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-68da8f33-9ad4-4183-9034-97e706a325e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:49.282936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.289868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.312860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.313653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.313940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.314221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.321388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.322934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:49.337412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:49.338315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:49.339288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 269/572] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:49.339986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.351783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 304/573] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:49.352684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da8f33-9ad4-4183-9034-97e706a325e6 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.450259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266f17-7e8f-4cbb-921b-0ea1f73dbf3a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.450482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da8f33-9ad4-4183-9034-97e706a325e6 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.483484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.483666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.484256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.484429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.484557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.484689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.484837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.484946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.485580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:49.485889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.487291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.491985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.496127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 270/574] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:49.496335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.496915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.497798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:49.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:49.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:49.517754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:49.517754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:49.517754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:49.517754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:49.517754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 305/575] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:49.518034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.531285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.598763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1e1eb-0334-4a2a-8bb1-608183642fe2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.616377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129fa1-47b0-4656-9917-ed8f92fb372d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.632028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.632693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.632985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.633266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.634060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:49.634377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.635831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.647653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 271/576] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:49.648429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.654340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.655033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.655325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.655607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.656653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:49.656967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.658401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.670118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 306/577] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:49.670900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.721795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.744514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.753478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966cbeb-4b5d-4c62-8aa4-db00ccfb7bf8 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.771872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e29ca7-2801-4c54-be05-71c30a4bc17d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.787027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.787836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.788128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.788415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.798357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:49.805755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.806556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:49.806690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:49.807781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:49.808651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:49.809282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.809282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.809758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 272/578] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:49.809758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.822243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.823747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:49.840972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:49.841985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:49.843008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:49.843008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:49.843008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:49.843008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:49.843008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 307/579] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:49.843008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.908930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550de127-5c68-4682-86d7-a5526d2fc21e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.941284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7fcfe-4fd4-4798-868a-750a5334caa9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:49.942540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.942780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.943327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.943623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.944185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.944625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:49.944938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.946362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.958198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 273/580] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:49.959116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:49.974531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:49.975593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:49.976334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:49.976636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:49.976928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:49.977763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=c42180b5adf242e489ddb24534daeea6) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:49.978079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:49.979541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:49.995113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 308/581] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/role_assignments?user.id=c42180b5adf242e489ddb24534daeea6&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:49.995113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.065761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3e24-0435-4d96-9dd9-550e68fad026 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.104080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.105023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.105308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.105584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/87a7fb173c0e439290808a6f9e1616f2/roles/7734ba45f7b24e8b83baeec31f464417` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.106494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046ff95-23e5-4d98-8055-61e67d87f84c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.122668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=87a7fb173c0e439290808a6f9e1616f2, role_id=7734ba45f7b24e8b83baeec31f464417)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.124168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.139357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 274/582] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:49 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/87a7fb173c0e439290808a6f9e1616f2/roles/7734ba45f7b24e8b83baeec31f464417 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:50.139547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.156070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.157080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.157368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.157667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.158448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:50.158759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.160794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.174551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 309/583] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:50.175602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.217346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:50.227632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:50.280609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e73a-338c-4ee3-abf4-a765cf0497cb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.316545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b31b2f-bb60-4783-af8b-2e1094a88f6f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.327036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.327817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.328399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.328399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.329114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:50.329425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.330802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.346558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 275/584] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:50.347440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.370170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.371866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.372586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.373077 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.384290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.387095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:50.407785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:50.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 18:33:50.409766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:50.413058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 310/585] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:50.413993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.473904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8840d-34c7-4f60-9262-b8a7956f8ba2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.507278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:50.515554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:50.522470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.523459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.523845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.524222 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.533694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe31d7-bd52-4bd4-a6cc-f8e05d7cde77 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.539935 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.541509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:50.559851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:50.560975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:50.562078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:50.562078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:50.562078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:50.562078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:50.567172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 276/586] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:50.568072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.577685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.579236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.579533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.579816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.591454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.592936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:50.607895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:50.608862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:50.609811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 311/587] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:50.610405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.705548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc717-acfa-4ccb-9f49-c599240eb768 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.739689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1083718-44ec-4370-b5e9-0361c307d5d6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.748094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.749331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.749900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.750286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.751281 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:50.752047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.754449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.781681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 277/588] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:50.781681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.787840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.788735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.789407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.790599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.791535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:50.791992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.793989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.814505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 312/589] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:50.814505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.825121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:50.832950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:50.912000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989997-cee5-4a1a-bde7-f81d3e9562d8 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.947730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.948562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.948951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.949378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:50.949768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1771ef-528b-46dd-91cb-d4c5d64fa865 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:50.950620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:50.951063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:50.952622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:50.974907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 278/590] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:50.976113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:50.987842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:50.989478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:50.989958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:50.990408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.001780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.003451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:51.022806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:51.023792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:51.024688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:51.024688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:51.024688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:51.024688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:51.031010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 313/591] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:51.032360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.070457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.082691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a842b-efcc-4980-887b-854fba5a6755 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.101595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.121320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.122392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.122782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.123191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.132190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.134096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.149975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e567447-11f5-4d5d-ab8e-8fc7e6bc95ec None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:51.161007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:51.162183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 18:33:51.163255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:51.168473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 279/592] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:51.168473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.196816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.197991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.198449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.198949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.210221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.211977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:51.231529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:51.232431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:51.233340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:51.233340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:51.233340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:51.233340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:51.235392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 314/593] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:51.236475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.280891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef38888-657f-4008-ad5c-e07a7af12507 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.318183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.319266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.319606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.319986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.321042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:51.321323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.322991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.341079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 280/594] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:51.342261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.349101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355814b3-0dd2-4caf-95bb-b02f7b59a2a1 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.356067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.364813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.388461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.389460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.389972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.390456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.391697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:51.392240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.394041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.418580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 315/595] 10.222.0.43 () {56 vars in 1139 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:51.419877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.454514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574525-9502-48ce-9d8f-574f7296853c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.491865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.492566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.492879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.493584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.493953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:51.494264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.495830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.512781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 281/596] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:51.513737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.530040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788157f3-f2fc-43e2-9034-69559f3a5c9b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.568191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.569326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.569826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.570362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.578093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.580086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.586729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:51.595652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:51.596539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:51.597448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:51.601354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 316/597] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:51.602354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.625265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75c3c-462c-4587-b1a3-16414225a4af None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.636687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.666076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.666887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.667495 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.667607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.678555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.680166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:51.698767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:51.699803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:51.700696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:51.700696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:51.700696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:51.700696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:51.704650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 282/598] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:51.705542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.720984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f673-6635-4dcd-92d5-2bb7521bf29a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.758378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.759555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.760150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.760720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.768264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.770757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:51.787392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:51.788331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:51.789256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:51.791994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 317/599] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:51.793071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.818665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b599609-5072-4884-bd23-232b58456dc3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.850709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.866560 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.867746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.868571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.869326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.870340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:51.870877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.873230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.889260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 283/600] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:51.890550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:51.903119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:51.915611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca1158-59d0-4aae-b46a-ebd478491de6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:51.951094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:51.951778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:51.952067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:51.952342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:51.953064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:51.953370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:51.954836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:51.967624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 318/601] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:51.971947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.026213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025ef78-dd90-42c9-9286-188d867b1400 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.060108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.060779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.061075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.061359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.062156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:52.062473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:52.063932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:52.079101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 284/602] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:52.079101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.079314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961a72f-381e-4528-a1ed-9ae57a8b8ec3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.113076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616714-5802-410b-981b-f0ec98f460a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.113939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616714-5802-410b-981b-f0ec98f460a8 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.114222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616714-5802-410b-981b-f0ec98f460a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.114505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616714-5802-410b-981b-f0ec98f460a8 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/880c7a0632ef44a1ab446d1bb53399fb/roles/7734ba45f7b24e8b83baeec31f464417` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.121242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:52.131111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3616714-5802-410b-981b-f0ec98f460a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=880c7a0632ef44a1ab446d1bb53399fb, role_id=7734ba45f7b24e8b83baeec31f464417)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:52.132983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3616714-5802-410b-981b-f0ec98f460a8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:52.142851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:52.159022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 319/603] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:51 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/880c7a0632ef44a1ab446d1bb53399fb/roles/7734ba45f7b24e8b83baeec31f464417 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:52.160658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04653-16bf-469b-b79a-c2ce3385f3b8 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.160953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04653-16bf-469b-b79a-c2ce3385f3b8 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.161272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04653-16bf-469b-b79a-c2ce3385f3b8 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.167067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 320/604] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:52.167067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04653-16bf-469b-b79a-c2ce3385f3b8 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.191837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f5280-9c13-4b86-bdc8-35e6249a9e69 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.232819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769a04-8094-4773-a5b2-1c49348702fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.234012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769a04-8094-4773-a5b2-1c49348702fa None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.234424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769a04-8094-4773-a5b2-1c49348702fa None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.234872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769a04-8094-4773-a5b2-1c49348702fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.244131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769a04-8094-4773-a5b2-1c49348702fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:52.245949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769a04-8094-4773-a5b2-1c49348702fa None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-18769a04-8094-4773-a5b2-1c49348702fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:52.263239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:52.264293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:52.265184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:52.265616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 285/605] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:52.267125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5db1-7ae8-4bfd-a693-6ebe1aed0d10 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.267502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5db1-7ae8-4bfd-a693-6ebe1aed0d10 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.267854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5db1-7ae8-4bfd-a693-6ebe1aed0d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.287356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-caed5db1-7ae8-4bfd-a693-6ebe1aed0d10 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:52.288579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-caed5db1-7ae8-4bfd-a693-6ebe1aed0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:52.311930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04653-16bf-469b-b79a-c2ce3385f3b8 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.350873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10021d-2630-4290-b895-19f564042603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.351845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10021d-2630-4290-b895-19f564042603 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.352131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10021d-2630-4290-b895-19f564042603 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.352410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10021d-2630-4290-b895-19f564042603 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/7d62786b3a2b40a6aea979d7875d410b/roles/7734ba45f7b24e8b83baeec31f464417` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.364451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 286/606] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:52.365299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5db1-7ae8-4bfd-a693-6ebe1aed0d10 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.371110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10021d-2630-4290-b895-19f564042603 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=7d62786b3a2b40a6aea979d7875d410b, role_id=7734ba45f7b24e8b83baeec31f464417)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:52.372856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10021d-2630-4290-b895-19f564042603 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:52.390980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 321/607] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:52 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/7d62786b3a2b40a6aea979d7875d410b/roles/7734ba45f7b24e8b83baeec31f464417 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:52.392749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffbb2f-5323-40e5-b47f-72f9684825eb None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.393262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffbb2f-5323-40e5-b47f-72f9684825eb None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.393749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffbb2f-5323-40e5-b47f-72f9684825eb None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.395741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 322/608] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:52.396725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffbb2f-5323-40e5-b47f-72f9684825eb None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.407854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:52.461381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:52.524241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5db1-7ae8-4bfd-a693-6ebe1aed0d10 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.524881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffbb2f-5323-40e5-b47f-72f9684825eb None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.569859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de85c9-0fe6-464b-9b9e-208f1e42ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.570681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de85c9-0fe6-464b-9b9e-208f1e42ee70 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.570907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.571085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de85c9-0fe6-464b-9b9e-208f1e42ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.571358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de85c9-0fe6-464b-9b9e-208f1e42ee70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.571559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.571847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.572119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.572922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:52.573237 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:52.574929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:52.582873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de85c9-0fe6-464b-9b9e-208f1e42ee70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b3de85c9-0fe6-464b-9b9e-208f1e42ee70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:52.590825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:52.591901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:52.593155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 323/609] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:52.594064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec2d6c-d6ff-43c7-a0c9-aed7bf6eb4c6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.594064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec2d6c-d6ff-43c7-a0c9-aed7bf6eb4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.594064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec2d6c-d6ff-43c7-a0c9-aed7bf6eb4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.600986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 287/610] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:52.602151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.612058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4aec2d6c-d6ff-43c7-a0c9-aed7bf6eb4c6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:52.613870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4aec2d6c-d6ff-43c7-a0c9-aed7bf6eb4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:52.697954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 324/611] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:52.699128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec2d6c-d6ff-43c7-a0c9-aed7bf6eb4c6 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.746345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:52.747661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:52.751292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c7e26-afe9-4475-a710-a3f9cd46a876 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.788163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.789123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.789563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.789996 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.790899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:52.791629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:52.793220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:52.803841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 288/612] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:52.804860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.828528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec2d6c-d6ff-43c7-a0c9-aed7bf6eb4c6 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.871529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.872778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.873262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.873692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/b3d7fbf23c584c32a518abd0b5326229/roles/7734ba45f7b24e8b83baeec31f464417` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.890151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=b3d7fbf23c584c32a518abd0b5326229, role_id=7734ba45f7b24e8b83baeec31f464417)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:52.892256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:52.914625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 325/613] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:52 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/b3d7fbf23c584c32a518abd0b5326229/roles/7734ba45f7b24e8b83baeec31f464417 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:52.916299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:52.925056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e8aa-9b26-489f-8c18-1caadb6fe90c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:52.966084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:52.967097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:52.967212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:52.967546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:52.980103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:52.988929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:52.989943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:52.990801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 289/614] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:52.996201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:53.018006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:53.037283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:53.057941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae324d-faac-4361-9153-8594695597c1 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:53.130345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:53.131741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:53.133416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:53.133711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:53.149616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:53.151148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:53.176563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470ccd-0e16-40d8-bb6f-c14bc5aa92ee None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:53.181403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:53.182286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:53.183203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:53.183203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:53.183203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:53.183203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:53.186040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 326/615] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:53.191540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:53.217259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:53.217931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:53.218435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:53.218561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:53.219326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:53.219635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:53.221068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:53.232741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 290/616] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:53.238386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:53.355383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:53.366137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d517b-f212-4e08-8641-ffcb7a6ece69 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:53.380851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de136f-efe2-40f7-b5ab-58a775ac94f2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:53.403513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:53.404434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:53.404870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:53.405296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:53.406259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:53.407005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:53.408812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:53.426941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:53.426941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:53.426941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:53.426941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:53.431694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:53.433156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:53.441237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 327/617] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:53.451063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:53.451986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:53.452869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:53.452869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:53.452869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:53.452869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:53.453106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:53.453178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 291/618] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:53.454937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:53.459725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:53.565107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9658e-b4c3-4654-b8ec-d7036b68e0fb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:53.599269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:53.604451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:53.605136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:53.605429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:53.605744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:53.607291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:53.607291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:53.608192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:53.628993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 292/619] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:53.634602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:53.726637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff257a2a-4312-4966-be79-5f0e4f3d8cbd None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:53.794560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:53.795405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:53.795699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:53.795983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:53.812486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:53.813960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:53.844560 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a8714-cee6-42ee-b617-719a3d122d41 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:53.846986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:53.848589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:53.850088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 328/620] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:53.855893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:53.935627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:53.936515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:53.936818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:53.937107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:53.939352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:53.954638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:53.956136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:53.989979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:53.992143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:33:53.994308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:53.995615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 293/621] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:33:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:54.001183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.016782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caa8f1-1d62-4e08-b6c6-fabc416fbd6d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.081284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:54.082520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.082812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.083098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.083997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:54.084312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:54.085750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:54.102576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:54.125421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 329/622] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Jun 20 18:33:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:54.133517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.167939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e00c-fd52-442b-9a00-f84b735c26ca None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.223641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:54.224409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.224588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.224880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.225737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:54.226052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:54.228917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:54.264054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 294/623] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:54.272025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.295843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26fa0e-cdfa-48c8-ace3-2c55efb42ddc None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.319111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:54.336232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a20fdb-ed5e-45e4-9605-64cc688040c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:54.337509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a20fdb-ed5e-45e4-9605-64cc688040c4 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.338000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a20fdb-ed5e-45e4-9605-64cc688040c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.338479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a20fdb-ed5e-45e4-9605-64cc688040c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.350999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a20fdb-ed5e-45e4-9605-64cc688040c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:54.352829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a20fdb-ed5e-45e4-9605-64cc688040c4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-00a20fdb-ed5e-45e4-9605-64cc688040c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:54.378374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:54.379917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:54.380814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:54.380814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:54.380814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:54.380814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:54.384657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 330/624] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:54.386005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfc5a5-0a7d-4a80-9c83-860b06d09038 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.386306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfc5a5-0a7d-4a80-9c83-860b06d09038 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.386597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfc5a5-0a7d-4a80-9c83-860b06d09038 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.388182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 331/625] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:54.388891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfc5a5-0a7d-4a80-9c83-860b06d09038 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.436280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc82db6-d919-44e1-bc5d-625a492001f4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.445160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:54.478364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:54.479792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.480379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.480958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.501905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfc5a5-0a7d-4a80-9c83-860b06d09038 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.540980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac949db-9dcd-4aa4-a031-17904eb24205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:54.542121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac949db-9dcd-4aa4-a031-17904eb24205 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.542624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac949db-9dcd-4aa4-a031-17904eb24205 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.543159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac949db-9dcd-4aa4-a031-17904eb24205 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.544180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac949db-9dcd-4aa4-a031-17904eb24205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:54.544782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac949db-9dcd-4aa4-a031-17904eb24205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:54.546390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac949db-9dcd-4aa4-a031-17904eb24205 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:54.559240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:54.560960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:54.562474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 332/626] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:54.564263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601385-bdf8-4995-a7b7-aedbaa3c9d61 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.564814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601385-bdf8-4995-a7b7-aedbaa3c9d61 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.565294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601385-bdf8-4995-a7b7-aedbaa3c9d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.582658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-04601385-bdf8-4995-a7b7-aedbaa3c9d61 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:54.584286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-04601385-bdf8-4995-a7b7-aedbaa3c9d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:54.612147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:54.661904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 333/627] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:54.663378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601385-bdf8-4995-a7b7-aedbaa3c9d61 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.681299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 295/628] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:54.687043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.695336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:54.801855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601385-bdf8-4995-a7b7-aedbaa3c9d61 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.806328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41baca0-b6dd-481d-9e8f-e6702041dda1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.840648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:54.841464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.841758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.842042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.842446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369568e-0920-4f9b-a661-87578157c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:54.843293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369568e-0920-4f9b-a661-87578157c2cd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.843589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369568e-0920-4f9b-a661-87578157c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.843874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369568e-0920-4f9b-a661-87578157c2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.849745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:54.851260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:54.855167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369568e-0920-4f9b-a661-87578157c2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:54.856801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369568e-0920-4f9b-a661-87578157c2cd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:54.865827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:54.866726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:54.867685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 334/629] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:54.868194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-9369568e-0920-4f9b-a661-87578157c2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:54.879964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:54.880931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:54.881845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:54.881845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:54.881845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:54.881845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:54.881845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 296/630] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:54.882683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13206de9-0df2-4699-9cc2-b52310a61db1 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:54.883092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13206de9-0df2-4699-9cc2-b52310a61db1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:54.883380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13206de9-0df2-4699-9cc2-b52310a61db1 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:54.887176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 297/631] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:54.887176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13206de9-0df2-4699-9cc2-b52310a61db1 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:54.901452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:54.950722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:54.982708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141704c-7c63-42e6-925a-a756547dd94d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:54.997942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13206de9-0df2-4699-9cc2-b52310a61db1 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.020224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.021553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.022011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.022303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.032947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:55.035862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7c57e-7258-4d36-a97c-146702c19785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.036703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7c57e-7258-4d36-a97c-146702c19785 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.037135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7c57e-7258-4d36-a97c-146702c19785 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.037573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7c57e-7258-4d36-a97c-146702c19785 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.038520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7c57e-7258-4d36-a97c-146702c19785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:55.039000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7c57e-7258-4d36-a97c-146702c19785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.040575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7c57e-7258-4d36-a97c-146702c19785 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:55.040872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:55.041977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:55.042870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 335/632] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:55.043632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.063139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 298/633] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:55.063139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d7ff3-9b0d-4086-8cdb-e7db45e9d6bb None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.063139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d7ff3-9b0d-4086-8cdb-e7db45e9d6bb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.063139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d7ff3-9b0d-4086-8cdb-e7db45e9d6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.078542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e43d7ff3-9b0d-4086-8cdb-e7db45e9d6bb None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:55.079990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e43d7ff3-9b0d-4086-8cdb-e7db45e9d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:55.133867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:55.152715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4cf9-4ccd-4777-a916-dc33a30a6bab None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.155034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 299/634] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:55.155887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d7ff3-9b0d-4086-8cdb-e7db45e9d6bb None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.203923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.204599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.204895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.205183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.205917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:55.206233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.208196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.220203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 336/635] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:55.220931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:55.221177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.275634 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d7ff3-9b0d-4086-8cdb-e7db45e9d6bb None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.308871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.309542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.309831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.310109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.310856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:55.311185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.312553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.319798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faacf0-2d07-4e27-9ea2-326ac922cd74 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.321029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 300/636] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:55.321634 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.353938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a92778-f2e8-4616-800f-9a90cc8b7a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.354836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92778-f2e8-4616-800f-9a90cc8b7a32 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.355154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92778-f2e8-4616-800f-9a90cc8b7a32 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.355438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92778-f2e8-4616-800f-9a90cc8b7a32 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/c42180b5adf242e489ddb24534daeea6/roles/7734ba45f7b24e8b83baeec31f464417` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.367460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:55.370605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a92778-f2e8-4616-800f-9a90cc8b7a32 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=c42180b5adf242e489ddb24534daeea6, role_id=7734ba45f7b24e8b83baeec31f464417)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.372363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a92778-f2e8-4616-800f-9a90cc8b7a32 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.384993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 337/637] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:33:55 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/c42180b5adf242e489ddb24534daeea6/roles/7734ba45f7b24e8b83baeec31f464417 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:33:55.386177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0056-2dd6-4bc0-a6f3-590db9c2cc27 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.386472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0056-2dd6-4bc0-a6f3-590db9c2cc27 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.386756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0056-2dd6-4bc0-a6f3-590db9c2cc27 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.388085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 338/638] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:55.388800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0056-2dd6-4bc0-a6f3-590db9c2cc27 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.435544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84be04c-02bd-4362-a96d-b08dac8d7aa3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.449795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:55.479633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.480509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.480801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.481643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.495962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:55.504815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:55.506031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 301/639] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:55.506880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.516548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0056-2dd6-4bc0-a6f3-590db9c2cc27 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.560715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9994-5dcf-4506-a9c4-5646ec3e58ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.561525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9994-5dcf-4506-a9c4-5646ec3e58ba None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.561813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9994-5dcf-4506-a9c4-5646ec3e58ba None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.562088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9994-5dcf-4506-a9c4-5646ec3e58ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.569602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9994-5dcf-4506-a9c4-5646ec3e58ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.571083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9994-5dcf-4506-a9c4-5646ec3e58ba None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-eeaf9994-5dcf-4506-a9c4-5646ec3e58ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:55.584879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:55.585827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 339/640] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e1664-30c5-4a1c-a315-87113f33a5d5 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.587541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e1664-30c5-4a1c-a315-87113f33a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.588147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e1664-30c5-4a1c-a315-87113f33a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.607360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-496e1664-30c5-4a1c-a315-87113f33a5d5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:55.608579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-496e1664-30c5-4a1c-a315-87113f33a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:55.627900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46c4f7-4dcf-4eeb-9c60-04cad78156af None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.661793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:55.671227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.672201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.672814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.673123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.690951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 340/641] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:55.690951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e1664-30c5-4a1c-a315-87113f33a5d5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.694674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.698821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:55.727316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:55.728352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:55.729264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:55.729264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:55.729264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:55.729264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:55.729264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 302/642] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:55.730055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.759137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:55.792486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e1664-30c5-4a1c-a315-87113f33a5d5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.834807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.835523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.835817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.836102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.836860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:55.837176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.838558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.841308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164196-63d5-4d0b-a667-ec51ea147991 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.855872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 341/643] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:55.855872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.877986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:55.878676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:55.878990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:55.879284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:55.880076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:55.880397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:55.881831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:55.894883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 303/644] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:55.896036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:55.907948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:55.969760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9ff9c-0e9d-4f48-902a-3b894f86e403 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:55.986941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.004721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.005533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.005821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.006103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.009282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287bf9-3978-4a86-ac1c-5a8258bf9abf None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.017787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:56.026339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:56.027322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:56.028316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 342/645] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:56.029078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.052271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.053346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.053647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.053927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.054933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:56.055276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.057131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.069612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 304/646] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:56.070573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.140402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f62dbb-aa56-4699-9434-d624f5d26a0c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.143972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.178393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.179146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f98114-1feb-47a3-ab74-a83ac36dc300 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.179259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.179506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.179787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.190482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.192170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:56.212247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:56.213378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:56.219556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:56.219556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:56.219556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:56.219556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:56.219556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 343/647] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:56.219556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.222192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.223512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.223863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.224211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.225124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=87a7fb173c0e439290808a6f9e1616f2) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:56.225508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.227357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.243761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 305/648] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/role_assignments?user.id=87a7fb173c0e439290808a6f9e1616f2&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:56.243761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.244331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.349838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ad70c-89eb-4058-a467-18c6594b08c5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.362800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3f1a-b447-432d-a396-07aefb7418e8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.392360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.393345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.393732 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.394115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.404114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.405724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.408423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.409385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.409833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.410669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.411477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:56.411790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.413156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.422777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 344/649] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:56.423126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:56.425892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:56.426797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:56.427784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 306/650] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:56.431865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.445593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.531214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.555920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e82f3-3354-4eb3-841f-233c6f235852 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.580063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189a84d-ecbc-4f28-bc8e-53a638749573 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.596957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.598136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.598891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.599379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.600283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:56.600783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.602743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.616484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.617419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.617837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.618176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.618328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 345/651] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:56.619318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.639122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.641101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:56.663616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:56.664752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:56.665869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:56.665869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:56.665869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:56.665869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:56.669754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 307/652] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:56.670587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.716209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.743866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7fbdc-8004-4d29-af71-b1ce98ece8ef None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.789725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.790786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.791554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.792122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.793207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:56.793837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.796049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.797217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523dea4-4c55-4231-8072-160622d5216b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.817954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 346/653] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:56.818298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.819496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.843162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.844365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.844797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.845219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.856812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.858692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:56.876138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:56.877376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:33:56.878524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:56.881347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 308/654] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:56.882270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:56.937142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f2873-dcc6-45eb-838a-fb9626fb1ff2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:56.974015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:56.974847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:56.975258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:56.975651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:56.976910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:56.977323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:56.979170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:56.987824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:56.998740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 347/655] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:57.000120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.010249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5010e-12bb-42a7-9f7c-dcd50ee49326 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.061630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.062784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.063813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.064278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.118025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c69ac-c3e4-4aa6-9806-5cfb34908852 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.132049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:57.157285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.158151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.158539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.158948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.159957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:57.160371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.162073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.166407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.168218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.187044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 348/656] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:57.188046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.253728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:57.301866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6be6b-d490-4c79-89ea-bed7ecb5c8da None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.309100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 309/657] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:57.310661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.346000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.348471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.348920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.349432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.359253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.361709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:57.385249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:57.386420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 18:33:57.387609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:57.389862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 349/658] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:57.390782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.404984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:57.437414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a9818-e271-45fc-8e72-68d780aed762 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.477616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18a38f-d111-4036-ae13-0295b1251e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.478279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a38f-d111-4036-ae13-0295b1251e02 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.478568 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a38f-d111-4036-ae13-0295b1251e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.478857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a38f-d111-4036-ae13-0295b1251e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.512556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ddd58-6572-4e4b-a4fa-346aaa99e152 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.529811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:57.551636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18a38f-d111-4036-ae13-0295b1251e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.553261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18a38f-d111-4036-ae13-0295b1251e02 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.556810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.557695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.558050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.558395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.568955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.570543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:57.588201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:57.589101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:57.590019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:57.590019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:57.590019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:57.590019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:57.590019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 350/659] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:57.590302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.638114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:57.667562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 310/660] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:57.667562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaec595-782d-4b99-bde6-c4aca5343702 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.667562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaec595-782d-4b99-bde6-c4aca5343702 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.667562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaec595-782d-4b99-bde6-c4aca5343702 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.667562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 311/661] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:57.667562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaec595-782d-4b99-bde6-c4aca5343702 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.707963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71f41-beb8-4446-ace7-16c9ce369c22 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.747972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.748948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.749434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.750014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.751006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:57.751415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.752942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.775563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 351/662] 10.222.0.43 () {56 vars in 1139 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:57.775563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.781178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaec595-782d-4b99-bde6-c4aca5343702 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.799817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:57.818342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cecf9-ada8-444c-9938-a0968bfa4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.819365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cecf9-ada8-444c-9938-a0968bfa4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.819818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cecf9-ada8-444c-9938-a0968bfa4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.820247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cecf9-ada8-444c-9938-a0968bfa4ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.821231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cecf9-ada8-444c-9938-a0968bfa4ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:57.821725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cecf9-ada8-444c-9938-a0968bfa4ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.823341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cecf9-ada8-444c-9938-a0968bfa4ff6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.842214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 312/663] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:57.843713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1b3c4-da63-438e-97de-29efddf77f6a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.844214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1b3c4-da63-438e-97de-29efddf77f6a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.844702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1b3c4-da63-438e-97de-29efddf77f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.862142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-78f1b3c4-da63-438e-97de-29efddf77f6a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:57.863716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-78f1b3c4-da63-438e-97de-29efddf77f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:57.874414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd489988-5220-4510-83f0-34720ea3b399 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:57.895443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:57.911064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:57.911870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:57.912159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:57.912440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:57.922326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:57.923798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:57.936034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 313/664] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:57.937087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1b3c4-da63-438e-97de-29efddf77f6a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:57.941253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:57.942139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:57.943070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:57.943070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:57.943070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:57.943070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:57.943070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 352/665] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:57.943642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.026085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.051672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8f842-bb1b-4098-9691-7991fe637eee None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.054322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1b3c4-da63-438e-97de-29efddf77f6a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.092246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.093072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.093403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.093715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.096958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.097867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.098341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.098804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.100847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.102331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:58.116280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:58.117254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 353/666] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:58.118660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.142787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.179702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.181068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.223395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284b46d-b307-4e5d-8ead-b4e377ad7413 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.257141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.257813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.258096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.258372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.259132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:58.259441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.260802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.263167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.274016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 354/667] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:58.274852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.290553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 314/668] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:33:58.291650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.360779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.385223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba63e7-415b-47c1-95fa-c3704157a777 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.397656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9436f-bf0d-4822-a5cb-b35b0c6ef5c3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.420414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.421220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.421505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.421790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.432720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:58.432854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.433513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.433803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.434087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.434883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:58.435230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.436660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:58.440397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:58.441907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:58.442763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 355/669] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:58.443542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.454290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 315/670] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:58.454290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.501690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.545410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ad255-d132-4dad-abe0-707bb420532f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.557864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136ca0e-03ba-4360-a6a6-66bea46cdb0d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.580178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5945-8060-4070-8eb6-cd64d6d71a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.581014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5945-8060-4070-8eb6-cd64d6d71a6b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.581306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5945-8060-4070-8eb6-cd64d6d71a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.581592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5945-8060-4070-8eb6-cd64d6d71a6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.583940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.588404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b5945-8060-4070-8eb6-cd64d6d71a6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.589858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b5945-8060-4070-8eb6-cd64d6d71a6b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.592571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.593377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.593668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.593954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-bf0b5945-8060-4070-8eb6-cd64d6d71a6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:58.603876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:58.604897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:58.610586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:58.611067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.611149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 356/671] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:58.611224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.611297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724871-c469-4799-8fc4-21dba30cf53a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.611297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724871-c469-4799-8fc4-21dba30cf53a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.611297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724871-c469-4799-8fc4-21dba30cf53a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.611297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 357/672] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:33:58.611297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724871-c469-4799-8fc4-21dba30cf53a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:58.626988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:58.627987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:58.629539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:58.629539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:58.629539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:58.629539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:58.629539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 316/673] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:58.630847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.712548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724871-c469-4799-8fc4-21dba30cf53a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.729936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.731032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da103c7-0d6e-44ae-826a-e4673f806182 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.748678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.749354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.749655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.749931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.750676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:58.751023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.752395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.760164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 358/674] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:58.760942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.764614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddacb0-94b8-44cf-a679-6d7228687aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.765170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddacb0-94b8-44cf-a679-6d7228687aef None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.765468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddacb0-94b8-44cf-a679-6d7228687aef None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.765755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddacb0-94b8-44cf-a679-6d7228687aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.766598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddacb0-94b8-44cf-a679-6d7228687aef None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=880c7a0632ef44a1ab446d1bb53399fb) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:58.766937 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddacb0-94b8-44cf-a679-6d7228687aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.768387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddacb0-94b8-44cf-a679-6d7228687aef None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.778964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 317/675] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/role_assignments?user.id=880c7a0632ef44a1ab446d1bb53399fb&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:58.778964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188c7e-d707-4a22-8151-a80df55de3dd None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.778964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188c7e-d707-4a22-8151-a80df55de3dd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.778964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188c7e-d707-4a22-8151-a80df55de3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.801374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-48188c7e-d707-4a22-8151-a80df55de3dd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:33:58.802748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-48188c7e-d707-4a22-8151-a80df55de3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:33:58.850607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:58.880391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847597-f0d1-4ad6-b577-e8b71c73f353 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:58.882754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 318/676] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:33:58.891945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48188c7e-d707-4a22-8151-a80df55de3dd None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.927630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:58.928462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:58.928585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:58.928863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:58.929994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:58.929994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:58.931518 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:58.947586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 359/677] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:58.948377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:58.996559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.002369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48188c7e-d707-4a22-8151-a80df55de3dd None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.044613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.045359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.045579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.045862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.046756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:59.046965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.048296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.060946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 319/678] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:59.061837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.066037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77e90d-56d9-43aa-8d40-24684d4ca318 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.095726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.103660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.104491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.104965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.105177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.116731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.118855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:59.136883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:59.137821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:59.138725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:59.138725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:59.138725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:59.138725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:59.142720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 360/679] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:59.143625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.169533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9c04-345f-46d2-ab9d-330e934d5646 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.208469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.209240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.209539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.209822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.220156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:33:59.228330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:59.229247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:59.230086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 320/680] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:59.230791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.248922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.262020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3d7e-096c-4478-8afe-cc58cc0dc37f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.298346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.299043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.299338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.299623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.302455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=7d62786b3a2b40a6aea979d7875d410b) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:59.302455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.302764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.319076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 361/681] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/role_assignments?user.id=7d62786b3a2b40a6aea979d7875d410b&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:59.319076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.333553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.341235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97ab71-2b2e-4e6f-8ae2-69e51d8f0804 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.382942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.384100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.384535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.385038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.392812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.394618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:33:59.411195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:59.412341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:33:59.413514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:59.415424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 321/682] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:59.416440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.450761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d071bb-aac2-4cc9-b357-fcfa21782680 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.490695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.491688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.492113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.492521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.493393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:59.493821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.495337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.510216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 362/683] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:59.511621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.528591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.532218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96006585-1faa-4a79-9a0f-db5b3e7b918a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.580392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.581081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.581372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.581653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.583042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:59.583369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.584939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.595053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 322/684] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:59.595662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.627813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.636359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c36f3e-3ccc-4b50-a273-e42baed19bc4 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.672560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.673427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.673815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.674217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.675295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:59.675637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.677724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.690451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 363/685] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:59.691577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.727192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50fe27-d18c-44cf-9743-5637f9567e57 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.764028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.765102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.765534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.765954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.770932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.775270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.776938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:33:59.793527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:59.794618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:33:59.795596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:33:59.798269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 323/686] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:59.799297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.804444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3460-9cef-4ebb-904e-e789cf467a3a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.840752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.841707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.842062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.842417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.855198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.856770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:33:59.875704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:33:59.876648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:33:59.877555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:33:59.877555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:33:59.877555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:33:59.877555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:33:59.877555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 364/687] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:33:59.877960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.889641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:33:59.916716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc601c-1f22-4a1d-8af5-8d7fe5684ba4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:33:59.950772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:33:59.951695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:33:59.952128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:33:59.952608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:33:59.953625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=b3d7fbf23c584c32a518abd0b5326229) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:33:59.954137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:33:59.955807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:33:59.963116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 324/688] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/role_assignments?user.id=b3d7fbf23c584c32a518abd0b5326229&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:33:59.964354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:33:59.988945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434bae5-089e-496d-9f1b-04e0e4df3531 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.021418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:00.032686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.033405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.033707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.033954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.034883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:00.035256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.036758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:00.061164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 365/689] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:00.062688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:00.111897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd916a-1ccb-4df5-bcab-fcdfc9922b9e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.156936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.158538 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.159062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.160011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.160974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:00.161913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.163810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:00.177781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:00.183556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 325/690] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:00.189338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f9ac-397b-46ae-a43c-d8ee7893fb29 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.190948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:00.228158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.228939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.229299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.229656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.288523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:00.311404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.312999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:00.354746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79456-335c-426d-bcf9-9f94f78ff63e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.394043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.394956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.395387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.395645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.403030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.404552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:00.422556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:00.423565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:00.424585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 326/691] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:34:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:00.429707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:00.441779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 366/692] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:34:00.447855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:00.503362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:00.553333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:00.557978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298b37a-0c40-400e-9335-8a71e88c299b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.575276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5dcd-0c12-402f-9e9a-0d6eb91ece2a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.638940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.642939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.642939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.642939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.642939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:00.642939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.645626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.646506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.646796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.646986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:00.648683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.674040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.676178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:00.682258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 327/693] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:34:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:00.687242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:00.720545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:00.721435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:00.722388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:00.722388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:00.722388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:00.722388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:00.722388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 367/694] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:00.728367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:00.824359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d4d92-bb03-4cb4-a79b-61f2d25170b5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.844018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:00.865095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4f652-5bd4-413e-8dfd-6437d11517cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.867895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4f652-5bd4-413e-8dfd-6437d11517cd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.867895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4f652-5bd4-413e-8dfd-6437d11517cd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.867895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4f652-5bd4-413e-8dfd-6437d11517cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.868154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629753a1-0c7d-4d40-94d4-4836921b0dda None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:00.905132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:00.905808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:00.906098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:00.906627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:00.907398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:00.907711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.909111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:00.911712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:00.921673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 368/695] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:00.927573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:00.946539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4f652-5bd4-413e-8dfd-6437d11517cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:00.948186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4f652-5bd4-413e-8dfd-6437d11517cd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.030893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58e3e2-9e5d-4e5e-8dc6-de8482d83f26 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.065285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef2f1e-5d63-41d5-80d0-020cb74fcc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.066256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2f1e-5d63-41d5-80d0-020cb74fcc0b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.067148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2f1e-5d63-41d5-80d0-020cb74fcc0b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.067565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2f1e-5d63-41d5-80d0-020cb74fcc0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.068382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 328/696] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 18:34:01.069790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29682bc7-5662-4131-b395-aba19e715d50 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.070088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29682bc7-5662-4131-b395-aba19e715d50 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.070373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29682bc7-5662-4131-b395-aba19e715d50 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.075206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 329/697] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:01.075903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29682bc7-5662-4131-b395-aba19e715d50 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.079596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef2f1e-5d63-41d5-80d0-020cb74fcc0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.081374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef2f1e-5d63-41d5-80d0-020cb74fcc0b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.095143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-e4ef2f1e-5d63-41d5-80d0-020cb74fcc0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:01.098223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:01.099297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:01.100390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:01.106679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 369/698] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:01.108200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96983-8cfb-4d24-b1cc-1d8daf45c866 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.108566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96983-8cfb-4d24-b1cc-1d8daf45c866 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.108946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96983-8cfb-4d24-b1cc-1d8daf45c866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.129289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0be96983-8cfb-4d24-b1cc-1d8daf45c866 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:01.131249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0be96983-8cfb-4d24-b1cc-1d8daf45c866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:01.193869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29682bc7-5662-4131-b395-aba19e715d50 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.194392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:01.213103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 370/699] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:01.214061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96983-8cfb-4d24-b1cc-1d8daf45c866 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.262798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.264215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.264617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.265002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.282294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.283801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:01.304733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:01.306768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:01.308861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:01.308861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:01.308861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:01.308861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:01.308861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 330/700] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:01.308861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.325778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96983-8cfb-4d24-b1cc-1d8daf45c866 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.362505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.363904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.364191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.364469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.365264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:01.365634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.367395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.380536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:01.385344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 371/701] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:01.386233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.423873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2f9a4-424a-4dee-b62f-9591d51a46b8 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.438103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:01.471875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.473243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.473537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.473851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.488448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.490635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.498245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bec60-2816-4291-bd11-6adfed271920 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:01.514352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:01.516081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:01.517529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:01.517529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:01.517529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:01.517529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:01.517529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 331/702] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:01.517529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.545574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.546358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.546721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.547173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.548054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:01.548887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.550634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.571016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 372/703] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:01.571996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.642607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202f778-db6b-4888-8958-02568801fe1c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.675292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:01.678804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc9f7-3b7c-404f-bf54-2699ca6be8e3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.683536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.684225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.684520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.684906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.685767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=c42180b5adf242e489ddb24534daeea6) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:01.686088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.687107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:01.688723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.699681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 332/704] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/role_assignments?user.id=c42180b5adf242e489ddb24534daeea6&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:01.704899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.726665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.727416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.727707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.727991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.728754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:01.729064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.730498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.745411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 373/705] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:01.754160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.866125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0660c-e22c-4647-aab1-e05315b2c78b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.892304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655087a1-5d17-42bb-b4a4-484e8ee28c26 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:01.909641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4276dc-becf-454a-8828-2d2dd8d077cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.910783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4276dc-becf-454a-8828-2d2dd8d077cd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.911337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4276dc-becf-454a-8828-2d2dd8d077cd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.911799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4276dc-becf-454a-8828-2d2dd8d077cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.919452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4276dc-becf-454a-8828-2d2dd8d077cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.921867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4276dc-becf-454a-8828-2d2dd8d077cd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.931625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fd75f-d337-4f7c-b32a-b114b9862916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:01.932306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd75f-d337-4f7c-b32a-b114b9862916 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.932596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd75f-d337-4f7c-b32a-b114b9862916 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.932892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd75f-d337-4f7c-b32a-b114b9862916 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.933601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fd75f-d337-4f7c-b32a-b114b9862916 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:01.935049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fd75f-d337-4f7c-b32a-b114b9862916 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-8d4276dc-becf-454a-8828-2d2dd8d077cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:01.938775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:01.939755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:01.940654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 333/706] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:01.942123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951fc1-c54b-4755-99d3-1c8ae248a07c None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.942943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951fc1-c54b-4755-99d3-1c8ae248a07c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.942943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951fc1-c54b-4755-99d3-1c8ae248a07c None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.944070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 334/707] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:01.948680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951fc1-c54b-4755-99d3-1c8ae248a07c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:01.963057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 374/708] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:34:01 2022] POST /identity/v3/users => generated 254 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:01.965246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31ef6-48b8-4f29-8338-ba06926be56d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:01.966586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31ef6-48b8-4f29-8338-ba06926be56d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:01.967300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e31ef6-48b8-4f29-8338-ba06926be56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:01.990195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b4e31ef6-48b8-4f29-8338-ba06926be56d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:01.992960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b4e31ef6-48b8-4f29-8338-ba06926be56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:02.009255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:02.035973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:02.085062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951fc1-c54b-4755-99d3-1c8ae248a07c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:02.094441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 375/709] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:02.120902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e31ef6-48b8-4f29-8338-ba06926be56d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:02.122841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:02.123585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:02.124124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:02.124328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:02.125199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:02.126460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:02.127116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:02.141556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 335/710] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:02.147878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:02.245367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e31ef6-48b8-4f29-8338-ba06926be56d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:02.284725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe12c-2d5d-4a16-8514-665b17bfd83d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:02.285869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:02.287004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:02.287511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:02.287991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:02.288865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:02.290471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:02.293032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:02.306734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:02.307846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:02.308711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:02.312121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 376/711] 10.222.0.43 () {56 vars in 1129 bytes} [Mon Jun 20 18:34:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:02.318636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:02.325297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:02.325972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:02.326253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:02.326530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:02.327408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=87a7fb173c0e439290808a6f9e1616f2) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:02.327722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:02.329166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:02.337011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 336/712] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:02 2022] GET /identity/v3/role_assignments?user.id=87a7fb173c0e439290808a6f9e1616f2&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:02.342902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:02.441652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4db8c-07cf-43bb-b1c6-a0c5e4d2272e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:02.482262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4631-007c-46b9-9487-58f595208eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:02.483321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4631-007c-46b9-9487-58f595208eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:02.483776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4631-007c-46b9-9487-58f595208eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:02.484206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4631-007c-46b9-9487-58f595208eb2 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:02.485095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4631-007c-46b9-9487-58f595208eb2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:02.485562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4631-007c-46b9-9487-58f595208eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:02.487166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4631-007c-46b9-9487-58f595208eb2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:02.493796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 377/713] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Jun 20 18:34:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:02.499695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:02.625997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243be48-d7ed-4d45-9ddd-08581446958a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:02.626813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e28bf-5c4c-490e-9301-f2e0be770af5 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:02.627150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e28bf-5c4c-490e-9301-f2e0be770af5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:02.627442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e28bf-5c4c-490e-9301-f2e0be770af5 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:02.628895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 378/714] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:02.634294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d961d-ac74-42fb-8446-772d8e77deac None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:02.634887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d961d-ac74-42fb-8446-772d8e77deac None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:02.634887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d961d-ac74-42fb-8446-772d8e77deac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:02.652243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-306d961d-ac74-42fb-8446-772d8e77deac None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:02.653379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-306d961d-ac74-42fb-8446-772d8e77deac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:02.674879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:02.676234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:02.677376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:02.677891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:02.678625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:02.678960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:02.680344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:02.696361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 337/715] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Jun 20 18:34:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:02.835860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 379/716] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:02.874751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:02.947328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:03.002252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afabfd-f862-47d8-9465-b412969d951f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:03.042831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:03.043759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:03.044047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:03.044328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] PATH_INFO: `/v3/services/network` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:03.045002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:03.046385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:03.061205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:03.062257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:03.063128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:03.067712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 338/717] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:02 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:03.069070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d961d-ac74-42fb-8446-772d8e77deac None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:03.084831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:03.274116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d961d-ac74-42fb-8446-772d8e77deac None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:03.320732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e323bb2-2c25-458f-ad60-af1f455527e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:03.321418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323bb2-2c25-458f-ad60-af1f455527e8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:03.321711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323bb2-2c25-458f-ad60-af1f455527e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:03.321997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e323bb2-2c25-458f-ad60-af1f455527e8 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:03.322716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323bb2-2c25-458f-ad60-af1f455527e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:03.323068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323bb2-2c25-458f-ad60-af1f455527e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:03.324464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e323bb2-2c25-458f-ad60-af1f455527e8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:03.330478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 380/718] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:03.339989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:03.539474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:03.545713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35994e65-a30a-4a30-9ae4-db6695516be7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:03.586086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde899b3-1f68-4873-b9d8-e03c60ceacba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:03.586762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde899b3-1f68-4873-b9d8-e03c60ceacba None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:03.587204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde899b3-1f68-4873-b9d8-e03c60ceacba None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:03.587487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde899b3-1f68-4873-b9d8-e03c60ceacba None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:03.588202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde899b3-1f68-4873-b9d8-e03c60ceacba None admin] RBAC: Adding query filter params (type=network) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:03.588512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde899b3-1f68-4873-b9d8-e03c60ceacba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:03.589899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde899b3-1f68-4873-b9d8-e03c60ceacba None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:03.599047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 339/719] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:04.392892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4504b2-bf3b-48e7-ba00-700f7a863a79 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:04.393807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4504b2-bf3b-48e7-ba00-700f7a863a79 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:04.394761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4504b2-bf3b-48e7-ba00-700f7a863a79 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:04.396522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 381/720] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:04.402064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b102aa-b92c-45da-bd98-873e992ee45f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:04.402893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b102aa-b92c-45da-bd98-873e992ee45f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:04.403434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b102aa-b92c-45da-bd98-873e992ee45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:04.420738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-40b102aa-b92c-45da-bd98-873e992ee45f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:04.422216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-40b102aa-b92c-45da-bd98-873e992ee45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:04.492423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 340/721] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:04.515853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4504b2-bf3b-48e7-ba00-700f7a863a79 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:04.621078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:04.659728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4504b2-bf3b-48e7-ba00-700f7a863a79 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:04.698844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:04.699692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:04.699978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:04.700260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:04.724618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:04.732593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:04.733638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:04.734544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 382/722] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:04.739665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b102aa-b92c-45da-bd98-873e992ee45f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:04.878353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:04.887345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b102aa-b92c-45da-bd98-873e992ee45f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:04.935552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f848-c78b-4f9d-9ba1-8422dfd9a595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:04.936152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f848-c78b-4f9d-9ba1-8422dfd9a595 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:04.936441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f848-c78b-4f9d-9ba1-8422dfd9a595 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:04.936724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f848-c78b-4f9d-9ba1-8422dfd9a595 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:04.937478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7f848-c78b-4f9d-9ba1-8422dfd9a595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:04.937788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7f848-c78b-4f9d-9ba1-8422dfd9a595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:04.939173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7f848-c78b-4f9d-9ba1-8422dfd9a595 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:04.950338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 341/723] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:04.955388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.048644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041369-5e74-4a69-8a6b-6c80848ab506 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.048966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041369-5e74-4a69-8a6b-6c80848ab506 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.049216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041369-5e74-4a69-8a6b-6c80848ab506 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.054813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 342/724] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:05.056346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956cb9-4d6c-4bfa-8976-b9ee63111878 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.056638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956cb9-4d6c-4bfa-8976-b9ee63111878 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.056921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956cb9-4d6c-4bfa-8976-b9ee63111878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.065510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f175bc-f811-4a14-9054-965468fb4b5b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.087183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d8956cb9-4d6c-4bfa-8976-b9ee63111878 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:05.088364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d8956cb9-4d6c-4bfa-8976-b9ee63111878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:05.102886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a49174-f18e-4777-84aa-88ccb31c72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.104054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a49174-f18e-4777-84aa-88ccb31c72af None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.104587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a49174-f18e-4777-84aa-88ccb31c72af None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.104877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a49174-f18e-4777-84aa-88ccb31c72af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.106955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:05.116870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a49174-f18e-4777-84aa-88ccb31c72af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:05.118472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a49174-f18e-4777-84aa-88ccb31c72af None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-f5a49174-f18e-4777-84aa-88ccb31c72af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:05.136946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:05.137965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:05.138888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:05.138888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:05.138888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:05.138888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:05.138888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 383/725] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:05.139788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eccf-1cd0-4647-9900-2d142de95d0c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.140082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eccf-1cd0-4647-9900-2d142de95d0c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.140373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eccf-1cd0-4647-9900-2d142de95d0c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.141758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 384/726] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:05.143878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36eccf-1cd0-4647-9900-2d142de95d0c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.171019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 343/727] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:05.172766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380cfd-38ff-4b1e-9b14-62fc2c353699 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.173063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380cfd-38ff-4b1e-9b14-62fc2c353699 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.173480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380cfd-38ff-4b1e-9b14-62fc2c353699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.196409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-77380cfd-38ff-4b1e-9b14-62fc2c353699 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:05.197949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-77380cfd-38ff-4b1e-9b14-62fc2c353699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:05.277382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36eccf-1cd0-4647-9900-2d142de95d0c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.284823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 344/728] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:05.285751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77380cfd-38ff-4b1e-9b14-62fc2c353699 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.311984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:05.334227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.335497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.335814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.336098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.336848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:05.337165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:05.339552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:05.355002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 385/729] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:05.355844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.408850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:05.414506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77380cfd-38ff-4b1e-9b14-62fc2c353699 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.450955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.451704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.451994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.452271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.463396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:05.464917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19af3a-8b2d-42b0-b243-f4790d2a2eb6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:05.470966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:05.471910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:05.473299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:05.477542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 345/730] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:05.478360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.503457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77023fe8-f8c8-4398-9929-a7a2f1c61ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.504597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77023fe8-f8c8-4398-9929-a7a2f1c61ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.505041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77023fe8-f8c8-4398-9929-a7a2f1c61ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.505330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77023fe8-f8c8-4398-9929-a7a2f1c61ca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.515852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77023fe8-f8c8-4398-9929-a7a2f1c61ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-77023fe8-f8c8-4398-9929-a7a2f1c61ca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:05.523690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:05.524666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:05.525517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 386/731] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:05.526228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5176-0d1e-4a90-aa01-dcad6929377b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.526779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5176-0d1e-4a90-aa01-dcad6929377b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.526779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5176-0d1e-4a90-aa01-dcad6929377b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.528069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 387/732] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:05.528614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e5176-0d1e-4a90-aa01-dcad6929377b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.565253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:05.590928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08a113-321c-44f3-b4af-813061b2cfc3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.626120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3e107-9afd-417b-8a81-61e4abe9f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.626964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e107-9afd-417b-8a81-61e4abe9f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.627263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e107-9afd-417b-8a81-61e4abe9f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.627550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e107-9afd-417b-8a81-61e4abe9f7a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.636947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3e107-9afd-417b-8a81-61e4abe9f7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:05.638502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3e107-9afd-417b-8a81-61e4abe9f7a1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:05.640288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e5176-0d1e-4a90-aa01-dcad6929377b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.647912 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-04d3e107-9afd-417b-8a81-61e4abe9f7a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:05.652857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:05.653825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:05.654803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 346/733] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:05.655445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e562ba-1fb7-4633-abde-d637fa2996c8 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.655516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e562ba-1fb7-4633-abde-d637fa2996c8 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.655950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e562ba-1fb7-4633-abde-d637fa2996c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.674598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-79e562ba-1fb7-4633-abde-d637fa2996c8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:05.675845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-79e562ba-1fb7-4633-abde-d637fa2996c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:05.685197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.685885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.686181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.686469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.687260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:05.687573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:05.688953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:05.698602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 388/734] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:05.699601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.755924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 347/735] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:05.756732 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e562ba-1fb7-4633-abde-d637fa2996c8 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.824523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:05.832491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b49e5-09c4-468c-9c35-27cba52d947f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.866621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e562ba-1fb7-4633-abde-d637fa2996c8 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:05.869509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.870006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.870300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.870586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.871375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:05.871690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:05.873068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:05.885735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 389/736] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:05.885735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.907494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:05.908112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:05.908401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:05.908671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:05.909516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:05.909933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:05.911387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:05.915933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:05.936605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 348/737] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:05.936605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:05.996740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172fbcc-27cf-4986-9582-53599588244e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.032290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.033210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.033611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.033899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.036484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecf2ad-d7d1-4e72-89ff-8df3e57844e0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.045209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.046823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.059721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:06.068669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:06.069589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:06.070507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:06.070507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:06.070507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:06.070507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:06.070507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 390/738] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:06.070792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.076328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.077018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.077315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.077605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.078340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.079792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.106951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 349/739] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:05 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:06.106951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.178623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.201050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf63a9-047f-4570-b01b-cd7e39dcd5ac None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.247835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.248574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.248897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.249204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.259704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01399267-c46e-4c3f-8acf-0c49740d00cf None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.261271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.262782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:06.283563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:06.284522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:06.285471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:06.285471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:06.285471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:06.285471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:06.285471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 391/740] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:06.285749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.303925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.304979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.305570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.305684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.360528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.382557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.384051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.400639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d257b9-9fa4-4431-b14e-db46e5bc3711 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.431302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.438407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a974587-fdd0-41fa-8549-06a239979599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.439114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a974587-fdd0-41fa-8549-06a239979599 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.439415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a974587-fdd0-41fa-8549-06a239979599 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.440129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a974587-fdd0-41fa-8549-06a239979599 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.441371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a974587-fdd0-41fa-8549-06a239979599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:06.441699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a974587-fdd0-41fa-8549-06a239979599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.443123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a974587-fdd0-41fa-8549-06a239979599 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.456097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 392/741] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:06.458059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0ad29-0e08-4deb-a1aa-7870c2f85112 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.458419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0ad29-0e08-4deb-a1aa-7870c2f85112 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.458796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0ad29-0e08-4deb-a1aa-7870c2f85112 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.462956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 393/742] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:06.462956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0ad29-0e08-4deb-a1aa-7870c2f85112 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.505695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 350/743] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 18:34:06.505695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.569492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0ad29-0e08-4deb-a1aa-7870c2f85112 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.592868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.605345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c46d-46da-4754-9d4a-cd51fab62d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.606022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c46d-46da-4754-9d4a-cd51fab62d9e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.606308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c46d-46da-4754-9d4a-cd51fab62d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.606586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c46d-46da-4754-9d4a-cd51fab62d9e None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.607348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c46d-46da-4754-9d4a-cd51fab62d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:06.607655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c46d-46da-4754-9d4a-cd51fab62d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.609032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c46d-46da-4754-9d4a-cd51fab62d9e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.614861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dffee-ce3c-4319-8b87-272ad1b040a9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.622174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 394/744] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:06.623824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bba94b-7fbd-4f0c-829b-bf6ed088ca0c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.623975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bba94b-7fbd-4f0c-829b-bf6ed088ca0c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.624247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bba94b-7fbd-4f0c-829b-bf6ed088ca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.641376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-66bba94b-7fbd-4f0c-829b-bf6ed088ca0c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:06.642580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-66bba94b-7fbd-4f0c-829b-bf6ed088ca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:06.656908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.658091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.658448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.658728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.666029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.667519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:06.682716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:06.683721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:06.684701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:06.687227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 351/745] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:06.688735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.692440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.722172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 395/746] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 18:34:06.722856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bba94b-7fbd-4f0c-829b-bf6ed088ca0c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.810073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab54b-82dd-4f12-868b-b36ef74e2e87 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.829347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bba94b-7fbd-4f0c-829b-bf6ed088ca0c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:06.848484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.849278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.849563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.849844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.860410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.862081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.863865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.867905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:06.868741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:06.869040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:06.869324 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:06.876936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:06.878671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:06.880809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:06.881703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:06.882613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:06.882613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:06.882613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:06.882613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:06.882613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 352/747] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:06.882897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:06.897298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:06.898341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 396/748] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:06.899923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:06.954008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:06.990987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005799c8-8fb2-47f0-a1a9-0bafe2abb654 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.016599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535c550-fbe1-465f-b4c5-8f5b0f0dcb31 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.030759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.031728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.032021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.032305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.033149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:07.033469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.035162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.052705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.053378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.053670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.053957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.054684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.059549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 353/749] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:34:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:07.059671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.059762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.075173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 397/750] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:06 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:07.075770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.139642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:07.204127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:07.207248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dae9b-5a5e-4736-b8da-0673271e3c41 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.215842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3ba5-64ae-4fc8-a245-775f82ba9060 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.259262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.260689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.260689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.260689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.261392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:07.261707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.262200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.262905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.263260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.263359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.263547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.264305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:07.264623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.266028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.283800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 354/751] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:07.285267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.291611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 398/752] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:07.292733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.400948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a86380-65c9-4b86-a43a-d1babbe77f34 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.414977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:07.429177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ba0f1-e376-4490-8336-02f00a2d8abc None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.444190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.445337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.445834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.446342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.458372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.460203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.467187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.468003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.468290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.468713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.476103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.477615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:07.481397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:07.482285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:07.483585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:07.483585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:07.483585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:07.483585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:07.490336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 355/753] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:07.491443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:07.492095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:07.492967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:07.493870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 399/754] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:07.494373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.514766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:07.602204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b143a94-78e1-44a2-9898-9eac0117aa23 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.606351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d94ac-3d31-48d3-b37c-233ca89777bb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.637297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.637963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.638259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.638587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.646606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.647636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.648135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.648726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.649949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:07.650814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.652703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.671116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 400/755] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:07.671940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:07.673172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.711096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.712579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.761958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:07.791932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d967-3f99-4775-ae42-37cc6790c4db None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.819832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 356/756] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:34:07.820745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.830800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.832015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.832520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.833068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.834181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:07.834734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.836698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.851552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 401/757] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:07.852813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:07.885698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:07.924968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed608e-abba-4409-aaeb-e1ca77a96547 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.960442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:07.961253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:07.961543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:07.961827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:07.968076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d5f1d-dda9-4e23-8b99-4b1c229b9a88 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:07.968677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:07.970127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:07.984481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:07.985419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:07.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:07.990356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 357/758] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:07.991214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.009396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.010662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.011249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.011768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.013986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:08.026357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.028242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:08.047848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:08.048802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:08.049740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:08.049740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:08.049740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:08.049740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:08.052272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 402/759] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:08.053294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.099983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d9a40-fb8b-4965-b9ed-ba0875285532 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.133152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:08.147786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.148460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.148747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.149029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.150193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=c42180b5adf242e489ddb24534daeea6) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:08.150512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.152431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.162202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 358/760] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:07 2022] GET /identity/v3/role_assignments?user.id=c42180b5adf242e489ddb24534daeea6&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:08.163560 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.184660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60135-9379-4532-a45f-8450f9d757a9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.225740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456a37c-f4f7-44d0-92b9-4077b7538166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.226976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a37c-f4f7-44d0-92b9-4077b7538166 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.227550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a37c-f4f7-44d0-92b9-4077b7538166 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.228064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a37c-f4f7-44d0-92b9-4077b7538166 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.229244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456a37c-f4f7-44d0-92b9-4077b7538166 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:08.229793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456a37c-f4f7-44d0-92b9-4077b7538166 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.231673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456a37c-f4f7-44d0-92b9-4077b7538166 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.247211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 403/761] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:08.249051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65c94-fe0c-4cfa-808f-0d2cb2bd6e13 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.249805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65c94-fe0c-4cfa-808f-0d2cb2bd6e13 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.250311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65c94-fe0c-4cfa-808f-0d2cb2bd6e13 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.252503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 404/762] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:08.253627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65c94-fe0c-4cfa-808f-0d2cb2bd6e13 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.315032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18cc67-30f4-4014-b27b-7ded236595f4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.324766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:08.362351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7a86-e78e-481d-b300-28dcc443433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.363981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7a86-e78e-481d-b300-28dcc443433f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.364277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7a86-e78e-481d-b300-28dcc443433f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.364562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7a86-e78e-481d-b300-28dcc443433f None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.365296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7a86-e78e-481d-b300-28dcc443433f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:08.365608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7a86-e78e-481d-b300-28dcc443433f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.367006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7a86-e78e-481d-b300-28dcc443433f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.383905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 359/763] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:08.383905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc81ef-e005-4ceb-912e-422c8ec4900b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.383905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc81ef-e005-4ceb-912e-422c8ec4900b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.383905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc81ef-e005-4ceb-912e-422c8ec4900b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.387243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65c94-fe0c-4cfa-808f-0d2cb2bd6e13 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.398900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b4dc81ef-e005-4ceb-912e-422c8ec4900b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:08.400275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b4dc81ef-e005-4ceb-912e-422c8ec4900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:08.432273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.433806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.434303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.434863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/87a7fb173c0e439290808a6f9e1616f2/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.437439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=87a7fb173c0e439290808a6f9e1616f2, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.439931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.447989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:08.463499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 405/764] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:34:08 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/87a7fb173c0e439290808a6f9e1616f2/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:34:08.465276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.495603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 360/765] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:08.518388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc81ef-e005-4ceb-912e-422c8ec4900b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.672878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc81ef-e005-4ceb-912e-422c8ec4900b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.679039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d301-fef0-483f-ac16-3fa5408207c7 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.699369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:08.723922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.724973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.725420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.725848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.726717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.728333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.728458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.729354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.729716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.730071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.738008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.739654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:08.743268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:08.744244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:08.745117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:08.748256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 361/766] 10.222.0.43 () {56 vars in 1129 bytes} [Mon Jun 20 18:34:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:08.758694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:08.759678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:08.760594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:08.761041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.763902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 406/767] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:08.768731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.835281 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:08.887833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23bb49-ab12-44c9-813a-f4b9783e3b6f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.926853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d15571-6536-4240-8371-09d205a5931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:08.928184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d15571-6536-4240-8371-09d205a5931a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:08.928684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d15571-6536-4240-8371-09d205a5931a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:08.929207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d15571-6536-4240-8371-09d205a5931a None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:08.930635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d15571-6536-4240-8371-09d205a5931a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:08.931285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d15571-6536-4240-8371-09d205a5931a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:08.933087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d15571-6536-4240-8371-09d205a5931a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:08.947863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 407/768] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:08.954095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d15571-6536-4240-8371-09d205a5931a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:08.969801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472366-beb2-4b63-b2b4-608f1db97176 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:08.988611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:09.064636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d15571-6536-4240-8371-09d205a5931a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:09.096277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:09.096887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.097717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.098014 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.098739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:09.099084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:09.100581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:09.108492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a7946-1944-4d05-9022-eab2d8fd7b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:09.109410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7946-1944-4d05-9022-eab2d8fd7b86 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.114284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7946-1944-4d05-9022-eab2d8fd7b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.114811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7946-1944-4d05-9022-eab2d8fd7b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.115933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a7946-1944-4d05-9022-eab2d8fd7b86 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=f9a909447947457d9b14e1369f2d8c93) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:09.116149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 362/769] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Jun 20 18:34:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:09.117170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:09.117691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a7946-1944-4d05-9022-eab2d8fd7b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:09.119371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a7946-1944-4d05-9022-eab2d8fd7b86 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:09.137395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 408/770] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:08 2022] GET /identity/v3/role_assignments?user.id=f9a909447947457d9b14e1369f2d8c93&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:09.279037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3ea89-0275-49be-be5d-3f78bb9f0650 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:09.291849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:09.294689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580e75-48e4-4da7-8b80-9bdcfb4c5119 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.296281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580e75-48e4-4da7-8b80-9bdcfb4c5119 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.296281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6580e75-48e4-4da7-8b80-9bdcfb4c5119 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.296934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 409/771] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:09.302607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee859d-48ef-4b6c-bbef-7fc67e109f79 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.302932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee859d-48ef-4b6c-bbef-7fc67e109f79 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.303244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee859d-48ef-4b6c-bbef-7fc67e109f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.332744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-77ee859d-48ef-4b6c-bbef-7fc67e109f79 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:09.333988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-77ee859d-48ef-4b6c-bbef-7fc67e109f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:09.352545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:09.353261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.353555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.353842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.354601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:09.354944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:09.356377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:09.367090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 363/772] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Jun 20 18:34:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:09.376038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:09.471436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 410/773] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:09.504474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58dd02-2e03-429a-8ea3-74570dfb0a68 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:09.533303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee859d-48ef-4b6c-bbef-7fc67e109f79 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:09.546384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:09.547088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.547378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.547661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.548457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] RBAC: Adding query filter params (interface=public, service_id=f3f0b63fd82b49318c138a52eafd4c46, region_id=RegionOne) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:09.548769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:09.550138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:09.557131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:09.565545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 364/774] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:34:09 2022] GET /identity/v3/endpoints?service_id=f3f0b63fd82b49318c138a52eafd4c46&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:09.571539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:09.630933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:09.720016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee859d-48ef-4b6c-bbef-7fc67e109f79 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:09.739157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a2b1-5e0c-4a06-bf6f-491c5fbafb30 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:09.786149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:09.786753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.787071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.787355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.788270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:09.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:09.795741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 365/775] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:09 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:09.803725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:09.804842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:09.805333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:09.805790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] PATH_INFO: `/v3/services/network` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:09.806635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:09.808243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:09.826383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:09.827487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:09.828331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:09.831119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 411/776] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:09 2022] GET /identity/v3/services/network => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:09.837010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:09.978106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:09.983414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039dd8-9e32-451e-8c7e-8c542def4dd1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:10.020011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:10.020696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.020984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.021263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.021973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] RBAC: Adding query filter params (name=network) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:10.022277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:10.023683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:10.028910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 366/777] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:10.035276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:10.122835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:10.140219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163eb3f-23a1-4cae-8084-fbafc24bcc68 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:10.176811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:10.177487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.177775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.178057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.178776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:10.179143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:10.180515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:10.186822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 412/778] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:10.192991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:10.319812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1205-9274-4755-b3cd-8c04765cfe2b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:10.363866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa291a-1815-42ff-af97-59a414e6e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:10.364545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa291a-1815-42ff-af97-59a414e6e333 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.364829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa291a-1815-42ff-af97-59a414e6e333 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.365161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa291a-1815-42ff-af97-59a414e6e333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.365961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa291a-1815-42ff-af97-59a414e6e333 None admin] RBAC: Adding query filter params (interface=public, service_id=bed1814366144b428eae1adbbd4b8af7, region_id=RegionOne) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:10.366273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa291a-1815-42ff-af97-59a414e6e333 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:10.367670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa291a-1815-42ff-af97-59a414e6e333 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:10.374967 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 367/779] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:34:10 2022] GET /identity/v3/endpoints?service_id=bed1814366144b428eae1adbbd4b8af7&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:10.380421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:10.491739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1600d-0cd6-4cf3-8178-92e8a3c80979 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.492071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1600d-0cd6-4cf3-8178-92e8a3c80979 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.492366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1600d-0cd6-4cf3-8178-92e8a3c80979 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.493987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 368/780] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:10.498730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b40ed-b13c-467a-ba5d-69159b5c71b7 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.499054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b40ed-b13c-467a-ba5d-69159b5c71b7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.499340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b40ed-b13c-467a-ba5d-69159b5c71b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.527512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bc1b40ed-b13c-467a-ba5d-69159b5c71b7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:10.529606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bc1b40ed-b13c-467a-ba5d-69159b5c71b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:10.532133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e0931-ec7f-40a1-b516-7e30270aa0e5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:10.578319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:10.604636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:10.605699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.606196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.606826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.607769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:10.609353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:10.616736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 413/781] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:10 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:10.677747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 369/782] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:10.725213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:10.746744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:10.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ed4c-278a-4d96-a4bb-e92e83e3f848 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:10.914009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6d39a-f925-4634-aa38-52f63e8ab6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:10.915267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6d39a-f925-4634-aa38-52f63e8ab6a3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.915785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6d39a-f925-4634-aa38-52f63e8ab6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.916268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6d39a-f925-4634-aa38-52f63e8ab6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.933576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6d39a-f925-4634-aa38-52f63e8ab6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-02e6d39a-f925-4634-aa38-52f63e8ab6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:10.943899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:10.944859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:10.945691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:10.948516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 414/783] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:10.954109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b40ed-b13c-467a-ba5d-69159b5c71b7 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:10.992859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234369d-3ff2-4f48-b8b6-651ebb72cd4f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:10.993517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234369d-3ff2-4f48-b8b6-651ebb72cd4f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:10.994024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234369d-3ff2-4f48-b8b6-651ebb72cd4f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:10.995908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 415/784] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:11.002455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feebbc-1965-4a3e-b89f-46468f11e75d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.003592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feebbc-1965-4a3e-b89f-46468f11e75d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.004107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feebbc-1965-4a3e-b89f-46468f11e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.033905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-77feebbc-1965-4a3e-b89f-46468f11e75d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:11.037469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-77feebbc-1965-4a3e-b89f-46468f11e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:11.121588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b40ed-b13c-467a-ba5d-69159b5c71b7 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:11.176070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 416/785] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:11.185587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:11.186552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.187084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.187590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.188604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:11.189118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:11.190699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:11.200203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 370/786] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:11.205440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feebbc-1965-4a3e-b89f-46468f11e75d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:11.208803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:11.221429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:11.258013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:11.354952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bfc58-4c0b-4189-a922-5484259717d4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:11.399621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:11.400441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.400727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.401006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.421332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:11.429853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feebbc-1965-4a3e-b89f-46468f11e75d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:11.438617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:11.439586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:11.441001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 371/787] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:11.447102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:11.473302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:11.474112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.474500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.474786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.501159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:11.502627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:11.539393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:11.540346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:11.541235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:11.541235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:11.541235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:11.541235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:11.543502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 417/788] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:11.551802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:11.567506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:11.592107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef3c9f-71ce-4443-9474-71c04c259653 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:11.632538 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:11.633606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.634280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.635606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.636566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:11.641718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:11.643431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:11.660348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 372/789] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:11.671581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:11.676815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:11.758314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe3f0-2004-49c5-9b0b-3875e8964e7f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:11.785759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f7750-53bd-4275-be65-25b007dbbac6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:11.796786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c98fe5-2868-4019-9ad7-aebf1ecd4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:11.798355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c98fe5-2868-4019-9ad7-aebf1ecd4294 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.798801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c98fe5-2868-4019-9ad7-aebf1ecd4294 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.799256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c98fe5-2868-4019-9ad7-aebf1ecd4294 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.800461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c98fe5-2868-4019-9ad7-aebf1ecd4294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:11.801394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c98fe5-2868-4019-9ad7-aebf1ecd4294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:11.803484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c98fe5-2868-4019-9ad7-aebf1ecd4294 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:11.819582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 418/790] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:11.825268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd457-70be-4824-b4b2-ee53cae150fd None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.825416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3bad7-72d5-478c-aeed-46eddaca3e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:11.825416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3bad7-72d5-478c-aeed-46eddaca3e27 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.825416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3bad7-72d5-478c-aeed-46eddaca3e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.825416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3bad7-72d5-478c-aeed-46eddaca3e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.826484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd457-70be-4824-b4b2-ee53cae150fd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.827387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd457-70be-4824-b4b2-ee53cae150fd None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.829101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 419/791] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:11.829991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd457-70be-4824-b4b2-ee53cae150fd None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:11.838953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:11.841943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3bad7-72d5-478c-aeed-46eddaca3e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:11.843968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3bad7-72d5-478c-aeed-46eddaca3e27 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-f6b3bad7-72d5-478c-aeed-46eddaca3e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:11.863782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:11.864733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:11.865626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:11.865626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:11.865626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:11.865626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:11.867987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 373/792] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:11.872637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c49e-97aa-4587-b76c-8243b9eefa8b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.872637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c49e-97aa-4587-b76c-8243b9eefa8b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.872637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2c49e-97aa-4587-b76c-8243b9eefa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.896221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-11b2c49e-97aa-4587-b76c-8243b9eefa8b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:11.897847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-11b2c49e-97aa-4587-b76c-8243b9eefa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:11.949297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd457-70be-4824-b4b2-ee53cae150fd None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:11.965791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:11.976580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 374/793] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:11.978168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2c49e-97aa-4587-b76c-8243b9eefa8b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:11.988428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:11.989273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:11.989568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:11.989848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:11.998190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:11.999886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:12.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:12.016501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:12.017470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 420/794] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:12.018070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.093188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2c49e-97aa-4587-b76c-8243b9eefa8b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.118648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.131789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.132684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74906-e54b-418b-a809-7574cbba3f47 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.133091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.133588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.134164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.135254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:12.135764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.137365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.154764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 375/795] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:12.155890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.169939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.170708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.171051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.171429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.182944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:12.191556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:12.192524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:12.193374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 421/796] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:12.194081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.231959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.279053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2bb4-e3ef-457d-9e96-d328d47baab1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.314342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478bed5-4c5c-48e0-91ed-714b08930bfb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.329765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.330486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.330777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.331094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.332260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:12.332581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.334641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.352563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a76aed-2d2b-4c72-9cea-38bfd5bc9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.353689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76aed-2d2b-4c72-9cea-38bfd5bc9503 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.354278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76aed-2d2b-4c72-9cea-38bfd5bc9503 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.354563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a76aed-2d2b-4c72-9cea-38bfd5bc9503 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.358599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 376/797] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:12.359543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.363316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a76aed-2d2b-4c72-9cea-38bfd5bc9503 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.364780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a76aed-2d2b-4c72-9cea-38bfd5bc9503 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-47a76aed-2d2b-4c72-9cea-38bfd5bc9503 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:12.378972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:12.379949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:12.380901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 422/798] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:12.383433 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563e79-090c-466e-ac0b-b7cd9816fa74 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.383939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563e79-090c-466e-ac0b-b7cd9816fa74 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.384462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563e79-090c-466e-ac0b-b7cd9816fa74 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.385991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 423/799] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:12.386904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41563e79-090c-466e-ac0b-b7cd9816fa74 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.406164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.465017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d547b58-31c9-4e77-aa03-546300edf290 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.495421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.499277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.499957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.500253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.500526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.501279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:12.501647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.503060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.506125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41563e79-090c-466e-ac0b-b7cd9816fa74 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.511578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 377/800] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:12.512380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.544989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28718041-f0e9-494d-aaf5-6659a9330fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.546376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28718041-f0e9-494d-aaf5-6659a9330fbd None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.546737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28718041-f0e9-494d-aaf5-6659a9330fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.547068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28718041-f0e9-494d-aaf5-6659a9330fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.559342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28718041-f0e9-494d-aaf5-6659a9330fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.560828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28718041-f0e9-494d-aaf5-6659a9330fbd None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-28718041-f0e9-494d-aaf5-6659a9330fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:12.579655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:12.580594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:12.581541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:12.581541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:12.581541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:12.581541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:12.581541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 424/801] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:12.582303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b041bd-391f-48ee-a427-387bf3bbbb51 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.582601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b041bd-391f-48ee-a427-387bf3bbbb51 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.582887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b041bd-391f-48ee-a427-387bf3bbbb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.600628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d5b041bd-391f-48ee-a427-387bf3bbbb51 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:12.601946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d5b041bd-391f-48ee-a427-387bf3bbbb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:12.621677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffb56-2f16-4175-946d-f0147c8bd894 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.623212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.658382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.659111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.659409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.660181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.661038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:12.661354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.662803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.678968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 425/802] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:12.678968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b041bd-391f-48ee-a427-387bf3bbbb51 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.697604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 378/803] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:12.698660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.761530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.787238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b041bd-391f-48ee-a427-387bf3bbbb51 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.804092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c5c6-2b15-4809-9f42-9c60ec83c2df None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.822790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.823622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.823911 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.824191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.836266 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.837725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.842906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.843615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.843902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:12.844185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:12.845337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:12.845654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:12.847541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:12.855789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:12.856668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:12.857576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:12.857576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:12.857576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:12.857576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:12.857576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 426/804] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:12.857851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.863815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 379/805] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:12.864893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:12.889640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.962027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1992571-8510-4097-9ef9-14558d49556c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.973309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b2a6-7c80-465d-b8fd-a151c714c1b1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:12.989304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:12.998790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:12.999492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:12.999787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.000071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.009705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.010526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.010813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.011131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.011830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.013139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:13.025686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:13.026615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:13.027499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 380/806] 10.222.0.43 () {56 vars in 1129 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:13.028343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.075920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.077388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.109460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.125228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e848b-6dc0-4e54-8a50-65bbbf306990 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.159078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572c9dd-67e2-4436-b97d-adacb3415fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.160264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c9dd-67e2-4436-b97d-adacb3415fe8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.160550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c9dd-67e2-4436-b97d-adacb3415fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.160832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572c9dd-67e2-4436-b97d-adacb3415fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.161551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572c9dd-67e2-4436-b97d-adacb3415fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:13.161857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572c9dd-67e2-4436-b97d-adacb3415fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.163233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572c9dd-67e2-4436-b97d-adacb3415fe8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.173791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 427/807] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:34:13.174614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.175862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 381/808] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:13.177099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f41f4-0b77-4bf9-b079-8f3a43e6399a None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.177393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f41f4-0b77-4bf9-b079-8f3a43e6399a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.177671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f41f4-0b77-4bf9-b079-8f3a43e6399a None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.178899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 382/809] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:13.182802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f41f4-0b77-4bf9-b079-8f3a43e6399a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.202686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.274294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807824a-35a5-4c0c-88ef-eee5c70a1edc None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.283506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f41f4-0b77-4bf9-b079-8f3a43e6399a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.308992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf38ac-dc83-47a0-8df2-01b4941b4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.309800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf38ac-dc83-47a0-8df2-01b4941b4bb1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.310196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf38ac-dc83-47a0-8df2-01b4941b4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.310370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf38ac-dc83-47a0-8df2-01b4941b4bb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.317388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf38ac-dc83-47a0-8df2-01b4941b4bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.318649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.318956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf38ac-dc83-47a0-8df2-01b4941b4bb1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.319342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.319633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.319918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.320620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:13.320930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.322275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.326642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 383/810] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:13.327439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-97cf38ac-dc83-47a0-8df2-01b4941b4bb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:13.333332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:13.334254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:13.335202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 428/811] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:13.336103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c379-83e9-44a3-a714-b7507c2c9e04 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.336103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c379-83e9-44a3-a714-b7507c2c9e04 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.336745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c379-83e9-44a3-a714-b7507c2c9e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.338973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.353217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-01a7c379-83e9-44a3-a714-b7507c2c9e04 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:13.354418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-01a7c379-83e9-44a3-a714-b7507c2c9e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:13.419631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 429/812] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:13.420447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c379-83e9-44a3-a714-b7507c2c9e04 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.429059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b54d5e-3ff9-4109-a249-6964b90c3e0b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.453489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.463522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.464357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.464647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.464931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.472109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.473579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:13.489617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:13.490613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 384/813] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:13.491582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.539131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c379-83e9-44a3-a714-b7507c2c9e04 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.556035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.572687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.573491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.573785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.574074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.584606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.586076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.589735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123dce9-4238-4cab-86ed-d9d6466c5a09 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:13.606732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:13.607725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:13.608622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:13.608622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:13.608622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:13.608622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:13.608622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 430/814] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:13.609330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.626692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.627399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.627686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.627969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.628709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:13.629015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.630397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.635141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 385/815] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:13.635907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.681501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.712259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660afd10-6ea2-4da5-8851-34b9bc9ede4c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.735435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb635ba2-f7ff-499f-98ca-03eb8fb21157 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.745211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.745876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.746163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.746469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.747286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:13.747599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.749032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.760642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 431/816] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:13.761409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.765922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.771059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.771874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.772162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.772444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] PATH_INFO: `/v3/services/network` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.773109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.774481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:13.786883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:13.788082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:13.789110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 386/817] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:13.790111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.862619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe84fbb-8735-4fe6-b9ad-e4fec90a99b2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.890491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:13.894147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224b98e-e70b-4738-a1c4-943b485c169d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:13.896854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.897533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.897823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.898104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.898970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:13.899286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.900730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.918569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 432/818] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:13.919378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:13.930572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:13.931334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:13.931586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:13.931876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:13.932607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:13.932918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:13.934287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:13.945976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 387/819] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:13.946724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.001436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:14.016821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca99aa-3307-4a30-b426-6b4bcdfc222c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.045691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c4c82-ce55-45c4-8a9f-693eebe56ade None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.051111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.051787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.052077 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.052362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.053519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.055279 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.075622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 433/820] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:14.076437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.100106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.101044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.101342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.101630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/c42180b5adf242e489ddb24534daeea6/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.103812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=c42180b5adf242e489ddb24534daeea6, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.105300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.119641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 388/821] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:34:13 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/c42180b5adf242e489ddb24534daeea6/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:34:14.120490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.139268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:14.218106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb25fa3-a33e-4cff-8a3a-6c69748791b5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.265395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.266187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.266537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.266825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.267593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] RBAC: Adding query filter params (name=network) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:14.267904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.269952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.274353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ef404-c4a7-4b74-ade1-f2dcb3900f4b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.276365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 434/822] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:14.277263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.295686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:14.328118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.329008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.329394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.329775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.343321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.345070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:14.364580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:14.365714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:14.366775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:14.366775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:14.366775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:14.366775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:14.368171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 389/823] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:14.369047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.405286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a7335-c4f2-4ab2-9a1a-624a8bdf62de None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.418179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:14.454940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.455771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.456216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.457136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.467529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.469011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.482794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996592b8-d7b3-4b40-ba25-6592fa05bb97 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:14.489261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:14.490309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:14.491439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 435/824] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:14.492030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.524810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.525585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.525947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.526304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.527117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] RBAC: Adding query filter params (type=network) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:14.527499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.528941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.534609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 390/825] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:14.540048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.570958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:14.620413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3538e-d09c-4dde-bb1e-dec312c41770 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.657594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.659008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.659805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.660294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.661234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:14.661351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d096-0ce8-452e-a1f4-0b7268b84c9b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.661897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.664474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.686948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 436/826] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:14.686948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.717067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.718043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.718342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.718630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.719484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:14.719805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.722625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.727284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:14.743132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 391/827] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:14.743132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.845028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:14.859590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a187e-28bb-4b4e-bd53-18a82bbf6196 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.898365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.899130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.899421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.899701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.907441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.908910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:14.923701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:14.924640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:14.925583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 392/828] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:14.926075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:14.937582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481fc57-6ed3-4718-bd8b-8e1f16719b06 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:14.981902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:14.982903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:14.983398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:14.983870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:14.985285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:14.987413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:15.014529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 437/829] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:15.016113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:15.037852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bdd87-3f27-4a48-9434-5e2f3e161338 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:15.085271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:15.086000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:15.086436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:15.086817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:15.087765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=87a7fb173c0e439290808a6f9e1616f2) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:15.088213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:15.089849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:15.097132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 393/830] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:14 2022] GET /identity/v3/role_assignments?user.id=87a7fb173c0e439290808a6f9e1616f2&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:15.150551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:15.174651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8228-31f1-4086-b77e-33d8154b2100 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:15.222791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8227db-9055-46fb-9851-f670748fe7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:15.223759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8227db-9055-46fb-9851-f670748fe7c8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:15.224175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8227db-9055-46fb-9851-f670748fe7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:15.224579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8227db-9055-46fb-9851-f670748fe7c8 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:15.225831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8227db-9055-46fb-9851-f670748fe7c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:15.226276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8227db-9055-46fb-9851-f670748fe7c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:15.228619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8227db-9055-46fb-9851-f670748fe7c8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:15.247065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 438/831] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:15.250899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:15.267444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:15.380265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de81d3-2a00-4dfb-9e2d-ffa783358169 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:15.423447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378a62-8326-4643-94ea-f4f0e3bb755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:15.424283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378a62-8326-4643-94ea-f4f0e3bb755d None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:15.424615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378a62-8326-4643-94ea-f4f0e3bb755d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:15.424863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378a62-8326-4643-94ea-f4f0e3bb755d None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/f9a909447947457d9b14e1369f2d8c93/roles/7734ba45f7b24e8b83baeec31f464417` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:15.441668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e378a62-8326-4643-94ea-f4f0e3bb755d None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=f9a909447947457d9b14e1369f2d8c93, role_id=7734ba45f7b24e8b83baeec31f464417)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:15.443175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e378a62-8326-4643-94ea-f4f0e3bb755d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:15.460278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 394/832] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:34:15 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/f9a909447947457d9b14e1369f2d8c93/roles/7734ba45f7b24e8b83baeec31f464417 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:34:16.315483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa005c5-b2c8-4525-ab33-b5a6415161d4 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.316045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa005c5-b2c8-4525-ab33-b5a6415161d4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.316122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa005c5-b2c8-4525-ab33-b5a6415161d4 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.317740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 439/833] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:16.324744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad50e0-aff5-4380-ba72-199ee32f9479 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.325172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad50e0-aff5-4380-ba72-199ee32f9479 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.325342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad50e0-aff5-4380-ba72-199ee32f9479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.332535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4315-8add-4704-95d4-85463044cd5d None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.332824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4315-8add-4704-95d4-85463044cd5d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.333107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4315-8add-4704-95d4-85463044cd5d None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.334458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 440/834] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:16.339458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34015165-79f7-4829-9b58-fa0b549d0771 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.339754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34015165-79f7-4829-9b58-fa0b549d0771 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.340039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34015165-79f7-4829-9b58-fa0b549d0771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.346466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-73ad50e0-aff5-4380-ba72-199ee32f9479 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:16.348238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-73ad50e0-aff5-4380-ba72-199ee32f9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:16.357455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-34015165-79f7-4829-9b58-fa0b549d0771 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:16.359012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-34015165-79f7-4829-9b58-fa0b549d0771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:16.439292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 441/835] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:16.463988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34015165-79f7-4829-9b58-fa0b549d0771 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:16.527029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:16.539461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:16.548034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 395/836] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:16.565839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34015165-79f7-4829-9b58-fa0b549d0771 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:16.570045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad50e0-aff5-4380-ba72-199ee32f9479 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:16.600614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:16.601442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.601728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.602077 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.614588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:16.622471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:16.623449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:16.624892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 442/837] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:16.632214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:16.698232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad50e0-aff5-4380-ba72-199ee32f9479 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:16.746248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:16.747500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.747890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.748272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.749277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:16.751463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:16.759505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d559f-25b1-4d18-a9fe-034873978d3d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:16.766991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:16.768166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:16.769640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:16.770402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 396/838] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:16.775629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:16.809940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:16.811151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.811452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.811737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.812785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:16.813106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:16.814769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:16.817695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:16.827598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 443/839] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:16.833134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:16.847738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:16.903305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ed330-4281-4ff7-a52f-2ed72c4aeea7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:16.939410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:16.940438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.941486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.941662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f19df-322b-4e27-b13f-38de1134d870 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:16.942145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.943186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:16.943699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:16.945323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:16.950794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 397/840] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:16.963801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:16.983500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:16.984347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:16.984639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:16.984917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:16.997147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:16.998816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:17.019861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:17.020830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:17.021863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:17.021863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:17.021863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:17.021863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:17.025178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 444/841] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:17.026565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:17.074766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5693f-4a3d-4895-9d01-c71a1298e850 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:17.092085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:17.095339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:17.114165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:17.115214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.115800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.116264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.117251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:17.117740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:17.119504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:17.124801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 398/842] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:17.154568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de36f5-1c21-4996-9d5a-e53e6ea83b55 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:17.193693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:17.194391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.194683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.194989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.195749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:17.196063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:17.197474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:17.211856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 445/843] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:17.217415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:17.327961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36df2-2326-4d26-9397-2ee877423b60 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:17.363916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f905d57-079c-4464-b1be-a3080d900173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:17.364786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f905d57-079c-4464-b1be-a3080d900173 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.365080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f905d57-079c-4464-b1be-a3080d900173 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.365363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f905d57-079c-4464-b1be-a3080d900173 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.373326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f905d57-079c-4464-b1be-a3080d900173 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:17.374749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f905d57-079c-4464-b1be-a3080d900173 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6f905d57-079c-4464-b1be-a3080d900173 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:17.389074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:17.390050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:17.391058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 399/844] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:17.396739 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:17.453668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73f421-bd27-419b-8bbf-8332210c2580 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.454321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73f421-bd27-419b-8bbf-8332210c2580 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.454803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73f421-bd27-419b-8bbf-8332210c2580 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.457272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 400/845] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:17.462583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b506e-9887-4910-a601-5a0b077a7cfa None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.463242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b506e-9887-4910-a601-5a0b077a7cfa None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.463735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b506e-9887-4910-a601-5a0b077a7cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.481325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-442b506e-9887-4910-a601-5a0b077a7cfa None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:17.483081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-442b506e-9887-4910-a601-5a0b077a7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:17.501826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889bf38-8900-4884-85e0-0e0233519774 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:17.512069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:17.529882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:17.543624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:17.544314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.544607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.544892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.545740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:17.546075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:17.547580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:17.562266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 401/846] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:17.563597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535f7c4-dff0-4d23-a3d5-d4bce88160ed None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.563892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535f7c4-dff0-4d23-a3d5-d4bce88160ed None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.564172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535f7c4-dff0-4d23-a3d5-d4bce88160ed None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.566176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 402/847] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:17.567729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 446/848] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Jun 20 18:34:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:17.572704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47293f35-2d58-4a70-99ee-e2d092380b04 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.573039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:17.573379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47293f35-2d58-4a70-99ee-e2d092380b04 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.573955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47293f35-2d58-4a70-99ee-e2d092380b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.594589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-47293f35-2d58-4a70-99ee-e2d092380b04 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:17.595707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-47293f35-2d58-4a70-99ee-e2d092380b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:17.670808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 403/849] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:17.670808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47293f35-2d58-4a70-99ee-e2d092380b04 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:17.686341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeced0-0fc4-4ee0-929b-67d6a1530200 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:17.724134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:17.724786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.725072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.725596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.762250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:17.776486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:17.779628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47293f35-2d58-4a70-99ee-e2d092380b04 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:17.800076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:17.801600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:17.817276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:17.818093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.818621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.818621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.819316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:17.820666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:17.832748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:17.833691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:17.834540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 404/850] 10.222.0.43 () {56 vars in 1132 bytes} [Mon Jun 20 18:34:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:17.835455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:17.910888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 447/851] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 18:34:17.912081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:17.946486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8474529-4b48-4880-b47a-e69e5dcf59e7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:17.978992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:17.984038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:17.984918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:17.985206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:17.985484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:17.996960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:18.005401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:18.006328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:34:18.007226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:18.011591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 405/852] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:34:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:18.012127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.019928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365174cb-ba87-4755-b8db-54abd023049d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.039778 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:18.055576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.056410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.056700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.056979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.057686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:18.058132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.059628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.069385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 448/853] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:18.070214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.117461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cc6f0-6300-4096-89c4-c293cb7ad20e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.152231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.153029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.153322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.153655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.164328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.165702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.180567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3cc26-0f98-41c7-9953-b39ad5167792 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:18.183505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:18.184387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:18.185283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:18.185283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:18.185283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:18.185283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:18.185283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 406/854] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:18.185577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.214710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:18.221292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.222051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.222345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.222628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.223441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:18.223756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.225137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.234966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 449/855] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:18.234966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.276074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:18.306224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f0d5d-4a41-4210-a430-4b734f05d56e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.340539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874999-ed21-4bd1-93cc-95a1b45abe3f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.342794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.343500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.343790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.344072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.344780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:18.345094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.346465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.351654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 407/856] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:18.352461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.390027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.391066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.391569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.392038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.392961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:18.393455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.395695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.409658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 450/857] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:18.415941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.479109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:18.497720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30688ee-c263-4173-83b3-86032ad429c2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.533039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb5ed4-e99f-4a68-ae47-631c61e0c310 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.549027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.549861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.550246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.550525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.559479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:18.562865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.564761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.579162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.579974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.580261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.580543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.588121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.589576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:18.593554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:18.594432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:18.595795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:18.595795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:18.595795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:18.595795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:18.597869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 408/858] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:18.604295 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:18.604420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:18.605243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:18.606124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 451/859] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:18.611180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.723245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d19a0-2e89-41a5-a5bc-87c077ebe111 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.730865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca240249-4d27-48bb-934b-098bf306020d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.736705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:18.758838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.759523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.759814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.760097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.760896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:18.761213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.762712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.771188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.772224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.772757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.773236 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.774155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:18.774685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.776310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.780867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 452/860] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:18.782012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.795192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 409/861] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:18.796357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:18.854017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:18.884831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7f395-212b-4afc-9d0c-4f4bcd1e81e0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.908139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53484295-4fd8-4522-bc66-0ec596e98250 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:18.920883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.921549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.921838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.922122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.922993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=c42180b5adf242e489ddb24534daeea6) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:18.923319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.924760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.936150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 453/862] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/role_assignments?user.id=c42180b5adf242e489ddb24534daeea6&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:18.947635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:18.948862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:18.949349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:18.949848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:18.959288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:18.961155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:18.978048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:18.979080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:18.980042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:18.982885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 410/863] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:18.989223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:19.029473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:19.101980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c5399-7a3b-40f3-a4bc-fddac5b91c7f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:19.137581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716cc22-a3aa-4e43-a71c-3afaa8060ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:19.138262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716cc22-a3aa-4e43-a71c-3afaa8060ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:19.138549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716cc22-a3aa-4e43-a71c-3afaa8060ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:19.138825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716cc22-a3aa-4e43-a71c-3afaa8060ef1 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:19.139697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716cc22-a3aa-4e43-a71c-3afaa8060ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:19.140008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716cc22-a3aa-4e43-a71c-3afaa8060ef1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:19.141437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716cc22-a3aa-4e43-a71c-3afaa8060ef1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:19.160378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 454/864] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Jun 20 18:34:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:19.166267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:19.235808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7292-c1c0-4f66-9ac0-b41a3e1be499 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:19.236120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7292-c1c0-4f66-9ac0-b41a3e1be499 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:19.236380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7292-c1c0-4f66-9ac0-b41a3e1be499 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:19.237979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 455/865] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:19.242872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4ee7c-3421-4c6a-9491-b6ae081fde74 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:19.243212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4ee7c-3421-4c6a-9491-b6ae081fde74 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:19.243536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4ee7c-3421-4c6a-9491-b6ae081fde74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:19.260773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-55d4ee7c-3421-4c6a-9491-b6ae081fde74 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:19.261967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-55d4ee7c-3421-4c6a-9491-b6ae081fde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:19.279865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b9a1b-0943-485c-93e3-93ad49af1ee2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:19.295406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:19.320503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:19.321617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:19.322238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:19.322747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:19.347048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 456/866] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:19.364288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4ee7c-3421-4c6a-9491-b6ae081fde74 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:19.395368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:19.396388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:19.398423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:19.476185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4ee7c-3421-4c6a-9491-b6ae081fde74 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:19.511848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:19.512448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:19.512737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:19.513020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:19.513765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:19.515183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:19.522388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 411/867] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:34:19.529114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:19.533876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 457/868] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:19 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:19.552278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:19.652423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c0698-33f6-4aef-8021-46910865cfc2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:19.699701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:19.700804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:19.701261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:19.701693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:19.713371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:19.715144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:19.733403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:19.734344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:19.735293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:19.735293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:19.735293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:19.735293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:19.738982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 412/869] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:19.740596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:19.836945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:19.855614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267fb09-72c8-4a85-aa57-04cb88e43e54 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:19.894885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:19.895610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:19.895899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:19.896186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:19.896922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:19.897233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:19.898606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:19.911455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 458/870] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:19.916739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:19.978844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:20.021115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b98fe-f5cd-4839-a356-4c75a2975494 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:20.056765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:20.057584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:20.057876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:20.058162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:20.065148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:20.067219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:20.081627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:20.082552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:20.083489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:20.087082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 413/871] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:20.088914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:20.193332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeccd8e-795a-4325-bfba-d75a22e1a1e3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:20.227782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4cae9-3886-443a-8068-e5b0e2f4e28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:20.228452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4cae9-3886-443a-8068-e5b0e2f4e28e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:20.228736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4cae9-3886-443a-8068-e5b0e2f4e28e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:20.229018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4cae9-3886-443a-8068-e5b0e2f4e28e None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:20.229802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4cae9-3886-443a-8068-e5b0e2f4e28e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:20.230110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4cae9-3886-443a-8068-e5b0e2f4e28e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:20.231611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4cae9-3886-443a-8068-e5b0e2f4e28e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:20.243842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 459/872] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:20.249611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:20.354840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd96c7-c357-4ef5-ad2c-71b7cd41808d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:20.375432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:20.390313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24b62c-fa64-476c-b1d3-c5af4d7c7d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:20.391444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24b62c-fa64-476c-b1d3-c5af4d7c7d63 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:20.391987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24b62c-fa64-476c-b1d3-c5af4d7c7d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:20.392667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24b62c-fa64-476c-b1d3-c5af4d7c7d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:20.393517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24b62c-fa64-476c-b1d3-c5af4d7c7d63 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=f9a909447947457d9b14e1369f2d8c93) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:20.394356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24b62c-fa64-476c-b1d3-c5af4d7c7d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:20.395822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24b62c-fa64-476c-b1d3-c5af4d7c7d63 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:20.407032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 414/873] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:20 2022] GET /identity/v3/role_assignments?user.id=f9a909447947457d9b14e1369f2d8c93&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:20.526272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b509a-ce0a-4775-8a18-990a4311ed5f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:20.526896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b509a-ce0a-4775-8a18-990a4311ed5f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:20.526896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b509a-ce0a-4775-8a18-990a4311ed5f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:20.528789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 460/874] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:20.534707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680511c-77f0-4c47-90c1-0598571a7b9c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:20.535347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680511c-77f0-4c47-90c1-0598571a7b9c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:20.535861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680511c-77f0-4c47-90c1-0598571a7b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:20.560851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-8680511c-77f0-4c47-90c1-0598571a7b9c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:20.562376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8680511c-77f0-4c47-90c1-0598571a7b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:20.634705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 415/875] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:20.659567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b509a-ce0a-4775-8a18-990a4311ed5f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:20.664005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:20.777519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b509a-ce0a-4775-8a18-990a4311ed5f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:20.814834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fb054-5bde-499f-9406-3b9b53d7d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:20.815579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fb054-5bde-499f-9406-3b9b53d7d213 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:20.815872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fb054-5bde-499f-9406-3b9b53d7d213 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:20.816155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fb054-5bde-499f-9406-3b9b53d7d213 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:20.816904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fb054-5bde-499f-9406-3b9b53d7d213 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:20.818268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fb054-5bde-499f-9406-3b9b53d7d213 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:20.835714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 461/876] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:20 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:21.102274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e45ef-7e57-42e8-8522-1b0c0449aadc None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.102562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e45ef-7e57-42e8-8522-1b0c0449aadc None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.103134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e45ef-7e57-42e8-8522-1b0c0449aadc None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.104954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 416/877] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:21.110292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29377252-d650-4471-9c76-455a3a37dc81 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.110830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29377252-d650-4471-9c76-455a3a37dc81 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.111363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29377252-d650-4471-9c76-455a3a37dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.129494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-29377252-d650-4471-9c76-455a3a37dc81 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:21.130986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-29377252-d650-4471-9c76-455a3a37dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:21.197149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:21.213054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 462/878] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:21.235620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e45ef-7e57-42e8-8522-1b0c0449aadc None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:21.349956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e45ef-7e57-42e8-8522-1b0c0449aadc None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:21.365495 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:21.387383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:21.388312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.388605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.388885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.389551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:21.390939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:21.403071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:21.404064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:21.404898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 417/879] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:21.413065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29377252-d650-4471-9c76-455a3a37dc81 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:21.517070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29377252-d650-4471-9c76-455a3a37dc81 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:21.552630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82df486-ae57-462f-98d2-0c5243654917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:21.553372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82df486-ae57-462f-98d2-0c5243654917 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.553603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82df486-ae57-462f-98d2-0c5243654917 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.553888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82df486-ae57-462f-98d2-0c5243654917 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.554616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82df486-ae57-462f-98d2-0c5243654917 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:21.554945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82df486-ae57-462f-98d2-0c5243654917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:21.556337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82df486-ae57-462f-98d2-0c5243654917 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:21.561639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 463/880] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:21.567636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:21.682150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66774-bd75-4e96-9290-81c703345745 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:21.701925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36306d76-c1fd-4a89-b36d-914e091d8870 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.702221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36306d76-c1fd-4a89-b36d-914e091d8870 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.702496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36306d76-c1fd-4a89-b36d-914e091d8870 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.704187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 464/881] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:21.709485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a913-6d79-42dd-879a-1c6fb7bd060e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.709815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a913-6d79-42dd-879a-1c6fb7bd060e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.710061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a913-6d79-42dd-879a-1c6fb7bd060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.725452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:21.726497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.726991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.727415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.728277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:21.728749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:21.730375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:21.731091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8987a913-6d79-42dd-879a-1c6fb7bd060e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:21.732491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8987a913-6d79-42dd-879a-1c6fb7bd060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:21.735779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 418/882] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:21.789099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:21.809092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 465/883] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:21.832674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:21.880397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:21.944333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c23c4-089b-40cc-9184-032b4cedafc7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:21.979829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:21.981001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:21.981491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:21.981995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:21.982857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:21.984457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:21.996859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:21.997944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:21.998791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:22.001371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 419/884] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:22.008125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a913-6d79-42dd-879a-1c6fb7bd060e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:22.109557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a913-6d79-42dd-879a-1c6fb7bd060e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:22.147045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:22.147737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:22.148029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:22.148316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:22.149039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:22.149353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:22.150743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:22.156204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 466/885] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:22.162400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:22.265474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9ad1-bf7b-4034-9c52-6701fd03d3d6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:22.273482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:22.301815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:22.302846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:22.303414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:22.303894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:22.304873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:22.305401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:22.307069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:22.312526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 420/886] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:22.319080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:22.368987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:22.421832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a7310-fb19-4933-a3be-5b651f430596 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:22.458251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6bdc-c811-4374-9b88-286062ddead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:22.459014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6bdc-c811-4374-9b88-286062ddead5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:22.459318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6bdc-c811-4374-9b88-286062ddead5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:22.459712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6bdc-c811-4374-9b88-286062ddead5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:22.460579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f6bdc-c811-4374-9b88-286062ddead5 None admin] RBAC: Adding query filter params (interface=public, service_id=b33b465295b645c2a8977b63e431e65f, region_id=RegionOne) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:22.460903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f6bdc-c811-4374-9b88-286062ddead5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:22.462409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f6bdc-c811-4374-9b88-286062ddead5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:22.470362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 467/887] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:34:22 2022] GET /identity/v3/endpoints?service_id=b33b465295b645c2a8977b63e431e65f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:22.476022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:22.579250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3190-5dd0-4db6-9614-bd4357799ef7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:22.614695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e42004-15e6-402b-af09-6609da29db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:22.615787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42004-15e6-402b-af09-6609da29db91 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:22.616293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42004-15e6-402b-af09-6609da29db91 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:22.616842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42004-15e6-402b-af09-6609da29db91 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:22.617738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e42004-15e6-402b-af09-6609da29db91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:22.619350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e42004-15e6-402b-af09-6609da29db91 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:22.625695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 421/888] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:22 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:34:22.648856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749e88-296c-4aee-bfac-58e6448d2c33 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:22.649404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749e88-296c-4aee-bfac-58e6448d2c33 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:22.649404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45749e88-296c-4aee-bfac-58e6448d2c33 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:22.651248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 468/889] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:22.657238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37927736-d779-494c-977b-55dbb972335f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:22.657846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37927736-d779-494c-977b-55dbb972335f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:22.658329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37927736-d779-494c-977b-55dbb972335f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:22.679847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-37927736-d779-494c-977b-55dbb972335f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:22.681092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-37927736-d779-494c-977b-55dbb972335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:22.713643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:22.759435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 422/890] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:22.782831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45749e88-296c-4aee-bfac-58e6448d2c33 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:22.889329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45749e88-296c-4aee-bfac-58e6448d2c33 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:22.902515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:22.924305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09e7de-4cdc-4acd-ac52-a6c1a162bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:22.925240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e7de-4cdc-4acd-ac52-a6c1a162bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:22.925529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e7de-4cdc-4acd-ac52-a6c1a162bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:22.925809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e7de-4cdc-4acd-ac52-a6c1a162bdc2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:22.936695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09e7de-4cdc-4acd-ac52-a6c1a162bdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8d09e7de-4cdc-4acd-ac52-a6c1a162bdc2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:22.945414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:22.946381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:22.947277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:22.951048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 469/891] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Jun 20 18:34:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:22.952757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37927736-d779-494c-977b-55dbb972335f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.043040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9c98d-2389-4f94-9c2a-d6dfd881fbfa None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.043336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9c98d-2389-4f94-9c2a-d6dfd881fbfa None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.043629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9c98d-2389-4f94-9c2a-d6dfd881fbfa None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.045261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 470/892] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:23.050813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6758ae-0f7f-4ea0-893d-63d41dde7d49 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.051137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6758ae-0f7f-4ea0-893d-63d41dde7d49 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.051419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6758ae-0f7f-4ea0-893d-63d41dde7d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.057081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37927736-d779-494c-977b-55dbb972335f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.068688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1d6758ae-0f7f-4ea0-893d-63d41dde7d49 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:23.069874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1d6758ae-0f7f-4ea0-893d-63d41dde7d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:23.106448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.107561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.108026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.108527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.109765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:23.111152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.113273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.124850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 423/893] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Jun 20 18:34:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:23.131134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.146310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 471/894] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:23.159699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:23.169679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6758ae-0f7f-4ea0-893d-63d41dde7d49 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.232745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3590b-95b1-457b-8b07-fbf9ea9d4858 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.265748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.266881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.267423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.267948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.273821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6758ae-0f7f-4ea0-893d-63d41dde7d49 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.275350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:23.279628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.281290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:23.299390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:23.300832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:23.301735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:23.301735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:23.301735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:23.301735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:23.308311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 424/895] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:23.309341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.312152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.313757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.313757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.313757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.314552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.316745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:23.330214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:23.331431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:23.332407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:23.338402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 472/896] 10.222.0.43 () {56 vars in 1132 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:23.339413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.407371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:23.419475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c5e6-72f7-44d6-ae1b-1bc86a1da3a5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.448022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2f707-8481-4d95-98d6-79ec0c15fdc8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.455577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.457108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.457590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.458070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.458993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:23.459497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.461099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.478286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 425/897] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:23.479451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.486738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.487579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.487937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.488293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.489350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:23.489470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.490858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.500661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 473/898] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:23.501574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.533867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:23.585622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0b586-52c5-4fa1-af11-2c0da0d5e588 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.608988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50db266-aa7d-44cb-911a-6e70ed9052be None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.621814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.622846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.623250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.623631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.631419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.632899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.634759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:23.646438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.647406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.647857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.648298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.649428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:23.650271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:23.651386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:23.652332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:23.653362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.654903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.657608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 426/899] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:23.658459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.666581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 474/900] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:23.667672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.763934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d809c-c266-4d3c-80ba-19ad71c06610 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.777791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:23.787192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4895b-bd88-43a2-a577-4986cacfb27b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.800450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.801235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.801524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.801907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.803066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:23.803181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.804745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.826768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.827861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.828319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.828768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.829734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] RBAC: Adding query filter params (interface=public, service_id=863fb3a03c114e659b0673c051c2516c, region_id=RegionOne) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:23.830242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.830671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 427/901] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:23.831850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.832341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.842714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 475/902] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/endpoints?service_id=863fb3a03c114e659b0673c051c2516c&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:23.843883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:23.891439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:23.937247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faffca-76cd-4875-852d-88e083de1944 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.953578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14292ef3-6abd-403b-92bf-6bf590782f64 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:23.972307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.972967 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.973253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.973533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.988167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a635d5-df5e-4ea6-abaa-55ca417562f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:23.988836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a635d5-df5e-4ea6-abaa-55ca417562f4 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:23.989131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a635d5-df5e-4ea6-abaa-55ca417562f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:23.989413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a635d5-df5e-4ea6-abaa-55ca417562f4 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:23.990106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a635d5-df5e-4ea6-abaa-55ca417562f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:23.991536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a635d5-df5e-4ea6-abaa-55ca417562f4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:23.997419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 476/903] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:34:24.001009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c28ad2-f024-413a-b4ca-90e936384cc6 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.001315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c28ad2-f024-413a-b4ca-90e936384cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.001608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c28ad2-f024-413a-b4ca-90e936384cc6 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.007087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 477/904] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:24.009771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6fca-b4c7-40e8-aea2-59115d6e605f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.010061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6fca-b4c7-40e8-aea2-59115d6e605f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.010349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6fca-b4c7-40e8-aea2-59115d6e605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.035776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-701b6fca-b4c7-40e8-aea2-59115d6e605f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:24.037673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-701b6fca-b4c7-40e8-aea2-59115d6e605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:24.062397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:24.075828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:24.078231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:24.141471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 478/905] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:24.154149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:24.167152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6fca-b4c7-40e8-aea2-59115d6e605f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:24.208364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 428/906] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:34:24.215059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:24.274174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6fca-b4c7-40e8-aea2-59115d6e605f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:24.309684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:24.310364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.310649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.310954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.311693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:24.313066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:24.332502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 479/907] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:24 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:34:24.345230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde630d1-fa08-4f78-a466-fc2eb18379ee None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:24.395324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:24.396545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.397037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.397583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.410513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:24.412514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:24.432783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:24.433742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:24.434649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:24.434649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:24.434649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:24.434649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:24.437111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 429/908] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:24.443288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:24.462595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:24.562414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d4a9f-a611-447b-8c5a-34dfb154a436 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:24.598824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e9bd3-1c94-45f0-ba87-9fe705b1eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:24.599928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e9bd3-1c94-45f0-ba87-9fe705b1eabb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.600422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e9bd3-1c94-45f0-ba87-9fe705b1eabb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.600934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e9bd3-1c94-45f0-ba87-9fe705b1eabb None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.601868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e9bd3-1c94-45f0-ba87-9fe705b1eabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:24.602406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e9bd3-1c94-45f0-ba87-9fe705b1eabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:24.604019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e9bd3-1c94-45f0-ba87-9fe705b1eabb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:24.617816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 480/909] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:24.626242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:24.627809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:24.740244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c045946-6f43-4530-aa30-1f6476b92ee1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:24.763741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fd671-4c12-48c6-aaf7-01f616f3e313 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.764748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fd671-4c12-48c6-aaf7-01f616f3e313 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.765280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fd671-4c12-48c6-aaf7-01f616f3e313 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.767294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 481/910] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:24.774337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fc613-479b-4d78-8c83-021dcd3d11e7 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.774631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fc613-479b-4d78-8c83-021dcd3d11e7 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.774941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fc613-479b-4d78-8c83-021dcd3d11e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.783402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:24.784511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.784981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.785453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.792661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:24.793163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f23fc613-479b-4d78-8c83-021dcd3d11e7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:24.794451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f23fc613-479b-4d78-8c83-021dcd3d11e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:24.794759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:24.810304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:24.811326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:24.812327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 430/911] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:24.817413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:24.883164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 482/912] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:24.900171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:24.900627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fc613-479b-4d78-8c83-021dcd3d11e7 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:24.904150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:24.947342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09de51c-5e33-4e0a-b696-8332bb8fcb8f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:24.996132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:24.996809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:24.997099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:24.997382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:24.998183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:24.998501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:25.000033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:25.017608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 431/913] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:25.019582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:25.026355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fc613-479b-4d78-8c83-021dcd3d11e7 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:25.068891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:25.069709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:25.069996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:25.070283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:25.070994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:25.072363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:25.084885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:25.085939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 18:34:25.087632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:25.091401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 483/914] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:25.092357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:25.157999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3728e-9587-428f-9a34-b7fd61590380 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:25.169663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:25.184379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:25.200968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:25.202657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:25.203227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:25.203880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:25.205393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] RBAC: Adding query filter params (role.id=208af3386e9c414cb5d64403e6202f99, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=f9a909447947457d9b14e1369f2d8c93) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:25.206066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:25.208197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:25.210505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27ea6-f337-4aa7-8776-93ad55a2b176 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:25.223556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 432/915] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:25 2022] GET /identity/v3/role_assignments?user.id=f9a909447947457d9b14e1369f2d8c93&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=208af3386e9c414cb5d64403e6202f99 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:25.253765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:25.254369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:25.254658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:25.254958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:25.255694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:25.256004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:25.257530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:25.263546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 484/916] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:25.269318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:25.379362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d25ca6-3bf0-40cc-8a1c-126ed84bbf34 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:25.418704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738ad40-11c0-42a4-ac43-ec6af99ad0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:25.419766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ad40-11c0-42a4-ac43-ec6af99ad0aa None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:25.420265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ad40-11c0-42a4-ac43-ec6af99ad0aa None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:25.420774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ad40-11c0-42a4-ac43-ec6af99ad0aa None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:25.421692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738ad40-11c0-42a4-ac43-ec6af99ad0aa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:25.422226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738ad40-11c0-42a4-ac43-ec6af99ad0aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:25.423826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738ad40-11c0-42a4-ac43-ec6af99ad0aa None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:25.430128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 433/917] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Jun 20 18:34:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:25.435357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:25.544086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba6c9-f900-462e-bb1a-0592d1cc23fd None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:25.576129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:25.583640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271e70d-abe1-44a0-b402-3d6533cc9484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:25.584651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271e70d-abe1-44a0-b402-3d6533cc9484 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:25.585183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271e70d-abe1-44a0-b402-3d6533cc9484 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:25.585690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271e70d-abe1-44a0-b402-3d6533cc9484 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:25.586669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271e70d-abe1-44a0-b402-3d6533cc9484 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:25.588416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271e70d-abe1-44a0-b402-3d6533cc9484 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:25.609071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 485/918] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:26.213208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d15333-d1e4-482d-9f00-9dc0fee1fa26 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.214225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d15333-d1e4-482d-9f00-9dc0fee1fa26 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.214724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d15333-d1e4-482d-9f00-9dc0fee1fa26 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.216638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 434/919] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:26.222039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240f0a-1481-48e6-bc50-4c927d9b34ae None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.222864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240f0a-1481-48e6-bc50-4c927d9b34ae None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.223416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240f0a-1481-48e6-bc50-4c927d9b34ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.241237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f0240f0a-1481-48e6-bc50-4c927d9b34ae None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:26.242743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f0240f0a-1481-48e6-bc50-4c927d9b34ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:26.327058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 486/920] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:26.345900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d15333-d1e4-482d-9f00-9dc0fee1fa26 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:26.403796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:26.462747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d15333-d1e4-482d-9f00-9dc0fee1fa26 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:26.498301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:26.499576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.500096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.500600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.501462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:26.503583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:26.507020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a677fa-51fc-4e42-907f-18cccf5ec019 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.507569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a677fa-51fc-4e42-907f-18cccf5ec019 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.508140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a677fa-51fc-4e42-907f-18cccf5ec019 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.509953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 487/921] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:26.516100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9cedb-b2eb-4d0b-823e-3af2bf158ee4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.516514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9cedb-b2eb-4d0b-823e-3af2bf158ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.516921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9cedb-b2eb-4d0b-823e-3af2bf158ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:26.519628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:26.520768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 18:34:26.521824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:26.524326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 435/922] 10.222.0.43 () {56 vars in 1132 bytes} [Mon Jun 20 18:34:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:26.531369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:26.543537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-28c9cedb-b2eb-4d0b-823e-3af2bf158ee4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:26.544984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-28c9cedb-b2eb-4d0b-823e-3af2bf158ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:26.622938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 488/923] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:26.640059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9cedb-b2eb-4d0b-823e-3af2bf158ee4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:26.670891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd8e8b-9916-4ab8-9e42-38b0922a06b6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:26.688906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:26.707511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:26.721543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:26.722522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.723076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.723578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.724508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:26.725989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:26.728659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:26.736146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 436/924] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:26.744089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:26.757371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9cedb-b2eb-4d0b-823e-3af2bf158ee4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:26.795089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:26.796158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.796619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.797085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.797926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:26.799552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:26.813469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:26.814535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:26.815973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:26.818081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 489/925] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:26.824677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:26.874854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8adf5f-2d55-463a-9d39-bc64543fa8e2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:26.919615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:26.921346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.921846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.922571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.923843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:26.925306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:26.926883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:26.934397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 437/926] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:26.939897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:26.941952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1fb8f-e45f-4879-a74e-93163d925d05 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:26.949788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:26.979331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:26.980407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:26.980948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:26.981433 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:26.982344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:26.982855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:26.984516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:26.990202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 490/927] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:26.996138 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:26.997293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:27.063071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8ab4-a4c2-4550-9e07-96f3aa7e04cf None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:27.098530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:27.099631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.100125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.100608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.101552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:27.103175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:27.112934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f771c8c-18bb-4466-b8bd-c9e0d6c8d5fd None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:27.129212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 438/928] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:34:27.170553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448d5dd-314d-4f97-a739-a80c30aab8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:27.171827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d5dd-314d-4f97-a739-a80c30aab8e8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.172352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d5dd-314d-4f97-a739-a80c30aab8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.172924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d5dd-314d-4f97-a739-a80c30aab8e8 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.174010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448d5dd-314d-4f97-a739-a80c30aab8e8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:27.174533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448d5dd-314d-4f97-a739-a80c30aab8e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:27.176827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448d5dd-314d-4f97-a739-a80c30aab8e8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:27.183511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 491/929] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:27.189216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:27.306810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:27.312669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986fefa-64c1-467d-8706-697f686364e3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:27.350202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0462a-29c0-40a2-850a-3270c6ae0fae None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.350701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0462a-29c0-40a2-850a-3270c6ae0fae None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.350701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0462a-29c0-40a2-850a-3270c6ae0fae None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.352327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 492/930] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:27.357126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:27.357390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70fd08-546c-4db5-b2de-65943cd37537 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.357685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70fd08-546c-4db5-b2de-65943cd37537 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.357971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70fd08-546c-4db5-b2de-65943cd37537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.358069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.358277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.358621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.359633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] RBAC: Adding query filter params (interface=public, service_id=7286f3f75d8a49c587ba776c53d0a75e, region_id=RegionOne) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:27.360030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:27.361485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:27.368818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 439/931] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:34:27 2022] GET /identity/v3/endpoints?service_id=7286f3f75d8a49c587ba776c53d0a75e&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:27.375307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:27.380989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-cd70fd08-546c-4db5-b2de-65943cd37537 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:27.382270 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-cd70fd08-546c-4db5-b2de-65943cd37537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:27.409784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:27.455506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 493/932] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:27.478873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70fd08-546c-4db5-b2de-65943cd37537 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:27.508142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cd539-6a3e-47a6-8490-af7aed8103b5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:27.556024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:27.557021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.557312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.557591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.558280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:27.559679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:27.566945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 440/933] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:27 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:34:27.601870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70fd08-546c-4db5-b2de-65943cd37537 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:27.641473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee63e5-1600-44d1-83fd-50650ae5b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:27.642654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee63e5-1600-44d1-83fd-50650ae5b21e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.643191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee63e5-1600-44d1-83fd-50650ae5b21e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.644177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee63e5-1600-44d1-83fd-50650ae5b21e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.656803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee63e5-1600-44d1-83fd-50650ae5b21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-d3ee63e5-1600-44d1-83fd-50650ae5b21e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:27.665743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:27.666779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:27.667644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:27.670236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 494/934] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Jun 20 18:34:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:27.677003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:27.711101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:27.734235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348fc5-54c8-43e1-8303-551df9be956b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.734562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348fc5-54c8-43e1-8303-551df9be956b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.735762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348fc5-54c8-43e1-8303-551df9be956b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.736910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 495/935] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:27.744152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b187-e79c-4adb-b6f4-1ee4a521f449 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.744586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b187-e79c-4adb-b6f4-1ee4a521f449 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.744967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b187-e79c-4adb-b6f4-1ee4a521f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.764871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e5a9b187-e79c-4adb-b6f4-1ee4a521f449 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:27.766337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e5a9b187-e79c-4adb-b6f4-1ee4a521f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:27.789398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:27.808608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5059-b254-491e-a1af-d039f397c36e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:27.845235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:27.846018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:27.846370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:27.847333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:27.848379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:27.848775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:27.850328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:27.859872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 441/936] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Jun 20 18:34:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:27.861520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 496/937] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:27.871928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:27.884389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9b187-e79c-4adb-b6f4-1ee4a521f449 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:27.975494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:27.987331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a511c-ee00-40b0-9d01-fd74b87855c9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.016278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9b187-e79c-4adb-b6f4-1ee4a521f449 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.024509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.025699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.026187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.026688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.039268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.041060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.059087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.059765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.060053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.060334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:28.060749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:28.061598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:28.062481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:28.062481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:28.062481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:28.062481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:28.062712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.062712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.063920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING keystone.server.flask.common [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 18:34:28.070077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 442/938] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:28.071297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:28.086327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.sql.core [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 18:34:28.086327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 18:34:28.086327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [parameters: {'id': '3a7f7a9e849749349b4f5d56eacfdd15', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 18:34:28.086327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86913) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a7f7a9e849749349b4f5d56eacfdd15.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a7f7a9e849749349b4f5d56eacfdd15. Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application conn.query(q) Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 18:34:28.108840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application result.read() Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 18:34:28.109721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application next(self.gen) Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application yield resource Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application next(self.gen) Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise self.value Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application session.commit() Jun 20 18:34:28.115798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self.session.flush() Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application compat.raise_( Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 18:34:28.116727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 18:34:28.118098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application conn.query(q) Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application result.read() Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 18:34:28.118882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [parameters: {'id': '3a7f7a9e849749349b4f5d56eacfdd15', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.121421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:28.123470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a7f7a9e849749349b4f5d56eacfdd15. Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 497/939] 10.222.0.43 () {60 vars in 1140 bytes} [Mon Jun 20 18:34:27 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:28.125603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:28.138430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:28.194472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d341-74e9-4768-b7c9-88de92fa3dd6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.232789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.233956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.234443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.234983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.236086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:28.236730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.238405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.254979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be80af-88a3-4046-9152-2d5692c73067 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.255676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 443/940] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:28.258835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:28.262407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:28.294747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.295877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.296368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.296820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.304074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.305957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:28.321583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:28.322551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:28.323501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.330865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 498/941] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:28.332888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:28.405511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1849f3-7660-4c18-b5ff-3c586a3c9e38 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.413205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:28.451039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.452510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.452806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.453094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.459601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d29b-306e-4c17-a743-f524f854154e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.464011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.465464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:28.483105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:28.484071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:28.485038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:28.492269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 444/942] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:34:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:28.493285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:28.500621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.501312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.501666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.501955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.502788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:28.503225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.505197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.538951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 499/943] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:28.583373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:28.616318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d73b-3c7c-49d2-8c38-ea6263840374 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.655026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.655788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.656023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.656310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.657433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:28.657750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.660001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.682762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 445/944] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Jun 20 18:34:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:28.692063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:28.830690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc172302-848d-4169-8dc6-ee953b90eccc None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:28.861667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:28.872115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:28.872930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:28.873214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:28.873552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:28.885157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:28.886616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:28.906105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:28.907393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:28.908367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:28.908367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:28.908367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:28.908367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:28.908367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 500/945] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:28.913906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.022779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cb6e4-62d7-42dc-8809-b6351c7e746d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:29.043941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:29.059445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:29.060128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.060421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.060708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.061444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:29.061763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:29.063161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:29.075844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 446/946] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:29.081106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.197208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a0e55-6ead-4b79-8afe-2f065330761e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:29.232827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519bb15-6063-4ad7-9230-5798e23e74af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:29.233639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519bb15-6063-4ad7-9230-5798e23e74af None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.233925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519bb15-6063-4ad7-9230-5798e23e74af None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.234204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519bb15-6063-4ad7-9230-5798e23e74af None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.241792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519bb15-6063-4ad7-9230-5798e23e74af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:29.243276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519bb15-6063-4ad7-9230-5798e23e74af None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b519bb15-6063-4ad7-9230-5798e23e74af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:29.258252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:29.260348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:29.262429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 501/947] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:29.265339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.323885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e469cd-fe6a-4c7e-83d1-986f35ac43ab None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.324385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e469cd-fe6a-4c7e-83d1-986f35ac43ab None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.324774 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e469cd-fe6a-4c7e-83d1-986f35ac43ab None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.326546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 502/948] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:29.331709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0af17-e758-49bc-b2ed-04bd41c0a003 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.332178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0af17-e758-49bc-b2ed-04bd41c0a003 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.332562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0af17-e758-49bc-b2ed-04bd41c0a003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.350855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ece0af17-e758-49bc-b2ed-04bd41c0a003 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:29.352761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ece0af17-e758-49bc-b2ed-04bd41c0a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:29.378750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474fe4c-fe2d-4f04-85ca-ae4f4f995d6b None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:29.387600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:29.417883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:29.418558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.418851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.419164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.419965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:29.420283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:29.421721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:29.432642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 503/949] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:29.446959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 447/950] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:29.448691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0af17-e758-49bc-b2ed-04bd41c0a003 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.459431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.505205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:29.566782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aeb36-d51a-4c89-8bbe-0ae34059a2da None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:29.572359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0af17-e758-49bc-b2ed-04bd41c0a003 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:29.605233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fecf31-ba76-4335-9c67-7cf28c444197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:29.606582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fecf31-ba76-4335-9c67-7cf28c444197 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.607121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fecf31-ba76-4335-9c67-7cf28c444197 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.607611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fecf31-ba76-4335-9c67-7cf28c444197 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.608561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fecf31-ba76-4335-9c67-7cf28c444197 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:29.610368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fecf31-ba76-4335-9c67-7cf28c444197 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:29.611213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:29.612199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.612489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.612771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/f9a909447947457d9b14e1369f2d8c93/roles/208af3386e9c414cb5d64403e6202f99` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.615080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=f9a909447947457d9b14e1369f2d8c93, role_id=208af3386e9c414cb5d64403e6202f99)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:29.616523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-95fecf31-ba76-4335-9c67-7cf28c444197 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:29.626077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:29.628349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:29.629340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:29.637184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 504/952] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:34:29 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/f9a909447947457d9b14e1369f2d8c93/roles/208af3386e9c414cb5d64403e6202f99 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:34:29.637544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 448/952] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:29.639300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.677138 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:29.758879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9a31-b659-4ec5-a2c6-327d7d1ac1b2 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:29.773543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ecef-7c85-45fd-aa2b-47ab304a035e None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.773769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ecef-7c85-45fd-aa2b-47ab304a035e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.773984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ecef-7c85-45fd-aa2b-47ab304a035e None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.775712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 449/953] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:29.781133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd581c-f3b2-48d6-9968-ec2ebead9680 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.781479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd581c-f3b2-48d6-9968-ec2ebead9680 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.781961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd581c-f3b2-48d6-9968-ec2ebead9680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.797646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:29.798340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.799632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.799632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.799864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e2cd581c-f3b2-48d6-9968-ec2ebead9680 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:29.799948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] RBAC: Adding query filter params (name=compute) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:29.800144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:29.800846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e2cd581c-f3b2-48d6-9968-ec2ebead9680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:29.801602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:29.807391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 505/954] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:29.814101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.901658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 450/955] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:29.924050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:29.928730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd581c-f3b2-48d6-9968-ec2ebead9680 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:29.938582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2948da-f3ef-4e30-b7e4-2e81faf26f6b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:29.969765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:29.978263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:29.979324 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:29.979944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:29.980431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:29.981558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:29.982087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:29.983780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:29.989996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 506/956] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:30.045645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd581c-f3b2-48d6-9968-ec2ebead9680 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:30.084078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:30.084925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:30.085216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:30.085501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:30.086180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:30.087605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:30.100722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:30.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:30.102976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 451/957] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:30.110701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:30.221386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d58f-e5ee-4e65-9e15-6c0835e7415f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:30.257107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:30.257783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:30.258067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:30.258343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:30.259084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:30.259390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:30.260822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:30.266078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 507/958] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:30.271613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:30.381400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ab86a-0592-4b53-9646-8c7eebc68ca9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:30.382978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:30.417157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a6c1e-87e8-4964-80c3-2a0ae0cf84c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:30.417840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a6c1e-87e8-4964-80c3-2a0ae0cf84c9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:30.418130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a6c1e-87e8-4964-80c3-2a0ae0cf84c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:30.418669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a6c1e-87e8-4964-80c3-2a0ae0cf84c9 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:30.419150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a6c1e-87e8-4964-80c3-2a0ae0cf84c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:30.419466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a6c1e-87e8-4964-80c3-2a0ae0cf84c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:30.420849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a6c1e-87e8-4964-80c3-2a0ae0cf84c9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:30.426412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 452/959] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:30.431997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:30.455857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:30.542821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e4988-b258-488f-8818-2f4ace47dc70 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:30.585881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe1578-05e6-416b-8a0d-bf209a91e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:30.586555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe1578-05e6-416b-8a0d-bf209a91e7f9 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:30.586842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe1578-05e6-416b-8a0d-bf209a91e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:30.587149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe1578-05e6-416b-8a0d-bf209a91e7f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:30.587904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe1578-05e6-416b-8a0d-bf209a91e7f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:30.589275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe1578-05e6-416b-8a0d-bf209a91e7f9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:30.612686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 508/960] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:30.804539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e81d-57ed-4f57-bcbb-5641b8e3d299 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:30.804737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e81d-57ed-4f57-bcbb-5641b8e3d299 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:30.805021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e81d-57ed-4f57-bcbb-5641b8e3d299 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:30.806701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 453/961] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:30.812147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1fa7-ad30-4bb5-9f52-a8c8d059dd85 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:30.812444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1fa7-ad30-4bb5-9f52-a8c8d059dd85 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:30.812728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1fa7-ad30-4bb5-9f52-a8c8d059dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:30.830565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e71e1fa7-ad30-4bb5-9f52-a8c8d059dd85 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:30.831801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e71e1fa7-ad30-4bb5-9f52-a8c8d059dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:30.909798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 509/962] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:30.934121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e81d-57ed-4f57-bcbb-5641b8e3d299 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:31.038044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e81d-57ed-4f57-bcbb-5641b8e3d299 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:31.073968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:31.075024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:31.075521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:31.076025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:31.076959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:31.078604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:31.080155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING keystone.server.flask.common [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 18:34:31.093427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.sql.core [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 18:34:31.093427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 18:34:31.093427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [parameters: {'user_id': '2664dae949044989aeecb1847e58ec73', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 18:34:31.093427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86914) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application conn.query(q) Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result.read() Jun 20 18:34:31.102356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 18:34:31.103294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application next(self.gen) Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application yield resource Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application next(self.gen) Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise self.value Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application session.commit() Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 18:34:31.104315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.session.flush() Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application compat.raise_( Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 18:34:31.105248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 18:34:31.106191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application conn.query(q) Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application result.read() Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 18:34:31.108928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [parameters: {'user_id': '2664dae949044989aeecb1847e58ec73', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:31.111060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 18:34:31.112283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 18:34:31.113927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 18:34:31.113927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 18:34:31.113927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 18:34:31.113927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 18:34:31.113927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 18:34:31.113927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:31.115875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 454/963] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Jun 20 18:34:30 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:31.124031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e1fa7-ad30-4bb5-9f52-a8c8d059dd85 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:31.126182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:31.236921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e1fa7-ad30-4bb5-9f52-a8c8d059dd85 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:31.272481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6a6e3-3f3e-4430-92cc-75bc9feeb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:31.273674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6a6e3-3f3e-4430-92cc-75bc9feeb215 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:31.274183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6a6e3-3f3e-4430-92cc-75bc9feeb215 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:31.274668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6a6e3-3f3e-4430-92cc-75bc9feeb215 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:31.282637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6a6e3-3f3e-4430-92cc-75bc9feeb215 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:31.284842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6a6e3-3f3e-4430-92cc-75bc9feeb215 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-43f6a6e3-3f3e-4430-92cc-75bc9feeb215 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:31.300146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:31.301135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 18:34:31.302107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:31.309121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 510/964] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:31.311051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:31.338952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:31.420260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20cb08-2ce2-41d6-b805-e92adf53fbfe None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:31.457527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf88f48-3ee5-4a9b-abee-d739467eae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:31.458699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88f48-3ee5-4a9b-abee-d739467eae04 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:31.459216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88f48-3ee5-4a9b-abee-d739467eae04 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:31.459711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88f48-3ee5-4a9b-abee-d739467eae04 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:31.460825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf88f48-3ee5-4a9b-abee-d739467eae04 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:31.461401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf88f48-3ee5-4a9b-abee-d739467eae04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:31.463288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf88f48-3ee5-4a9b-abee-d739467eae04 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:31.502654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 455/965] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Jun 20 18:34:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:31.801595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001c97c-45c7-4d49-8a97-c3c11986a7a0 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:31.802168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001c97c-45c7-4d49-8a97-c3c11986a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:31.802168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001c97c-45c7-4d49-8a97-c3c11986a7a0 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:31.803932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 511/966] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:31.809684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5668-8aa2-423f-bb35-345e46941777 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:31.810041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5668-8aa2-423f-bb35-345e46941777 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:31.810326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5668-8aa2-423f-bb35-345e46941777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:31.827471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-647b5668-8aa2-423f-bb35-345e46941777 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:31.828956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-647b5668-8aa2-423f-bb35-345e46941777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:31.898953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 456/967] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:31.918877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001c97c-45c7-4d49-8a97-c3c11986a7a0 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:31.982375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:32.022104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001c97c-45c7-4d49-8a97-c3c11986a7a0 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:32.056014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0685152-e360-4601-bef1-b6c493def49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:32.056834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0685152-e360-4601-bef1-b6c493def49b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.057122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0685152-e360-4601-bef1-b6c493def49b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.057412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0685152-e360-4601-bef1-b6c493def49b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.067282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0685152-e360-4601-bef1-b6c493def49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b0685152-e360-4601-bef1-b6c493def49b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:32.075457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:32.076407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:32.077275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 512/968] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Jun 20 18:34:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:32.084377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5668-8aa2-423f-bb35-345e46941777 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.099076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:32.109537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0bf67-05a3-4625-85b5-afe5c8b1583c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.109831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0bf67-05a3-4625-85b5-afe5c8b1583c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.110121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0bf67-05a3-4625-85b5-afe5c8b1583c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.111646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 513/969] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:32.116836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc94a6-49af-4d19-8f73-265647eef375 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.117099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc94a6-49af-4d19-8f73-265647eef375 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.117387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc94a6-49af-4d19-8f73-265647eef375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.133981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-cabc94a6-49af-4d19-8f73-265647eef375 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:32.135173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-cabc94a6-49af-4d19-8f73-265647eef375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:32.188683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5668-8aa2-423f-bb35-345e46941777 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:32.207852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 514/970] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:32.222985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:32.223731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.224090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.224442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.225258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:32.225641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:32.227099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:32.230346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc94a6-49af-4d19-8f73-265647eef375 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.235732 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 457/971] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Jun 20 18:34:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:32.241324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.289803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:32.317475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:32.341456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc94a6-49af-4d19-8f73-265647eef375 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:32.344292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607968f-903d-4390-994d-3e3ed76767a5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:32.378831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:32.379266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:32.379779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.380068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.380258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.380360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.380620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.380802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.381624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:32.383131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:32.392114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:32.394088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:32.406945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 515/972] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:32 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:32.419383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:32.420823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:32.421770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:32.421770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:32.421770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:32.421770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:32.421770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 458/973] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:32.427278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.543635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325c3e2-0830-48cc-9991-8e9a34e8089e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:32.555978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:32.580346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212b272-bcee-4946-90d2-c2d1652710e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:32.581042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212b272-bcee-4946-90d2-c2d1652710e8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.581323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212b272-bcee-4946-90d2-c2d1652710e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.581626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212b272-bcee-4946-90d2-c2d1652710e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.582330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212b272-bcee-4946-90d2-c2d1652710e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:32.582643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212b272-bcee-4946-90d2-c2d1652710e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:32.584055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212b272-bcee-4946-90d2-c2d1652710e8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:32.596434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 516/974] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:32.602052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.709748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d327e62-4554-4487-a477-cb84d264b2d6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:32.741471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:32.750409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:32.751263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.751549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.751826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.760045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:32.761691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:32.763283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7e5a-8505-4b1a-8d6d-e12be3e2de8e None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.763586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7e5a-8505-4b1a-8d6d-e12be3e2de8e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.763869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7e5a-8505-4b1a-8d6d-e12be3e2de8e None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.765391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 517/975] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:32.770936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c0a92-299e-4f50-ae5c-6b55085f29f9 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.771246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c0a92-299e-4f50-ae5c-6b55085f29f9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.771534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c0a92-299e-4f50-ae5c-6b55085f29f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:32.777163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:32.778147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 18:34:32.779157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:32.783196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 459/976] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:34:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:32.784064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.789824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1f9c0a92-299e-4f50-ae5c-6b55085f29f9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:32.791059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1f9c0a92-299e-4f50-ae5c-6b55085f29f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:32.870995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 518/977] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:32.887453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c0a92-299e-4f50-ae5c-6b55085f29f9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.889048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904ca20-1b34-4128-9a8d-378b87b23eb6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:32.923777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:32.924463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:32.925294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:32.925579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:32.926426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:32.926740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:32.928211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:32.946197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 460/978] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Jun 20 18:34:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:32.951858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:32.998231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:32.998571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:33.003410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c0a92-299e-4f50-ae5c-6b55085f29f9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.040779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.042222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.042819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.043346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.044586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.046434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.056833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c329-a465-4aa4-9bd6-55e45641684c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:33.062577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:33.063644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:33.064493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:33.065285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 519/979] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:33.070871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.092729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.093395 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.093685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.093971 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.164927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.166606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.188209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149abf-2f85-461d-828b-1f3a45abcd8e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.210368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:33.225326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.226255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.226802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.227265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.228141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:33.228455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.229877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.239809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 520/980] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:33.240778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.267706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:33.275338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 461/981] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:32 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 18:34:33.280813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.349972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024708fe-a24f-4b87-baf9-dd8b70783cf6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.382073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8cedf-29b4-4c8d-be34-059d59f66ffe None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.384052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.384750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.385015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.385293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.386004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:33.386313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.387706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.392740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 521/982] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:33.398398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.430856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.431620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.432072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.432357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.445192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.446629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.449558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:33.467758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:33.468726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:33.469631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:33.469631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:33.469631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:33.469631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:33.469631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 462/983] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:33.474424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.494169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:33.505395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef918aa-c4b6-419f-8e13-f4af4d14e448 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.542589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.543315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.543608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.543895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.544832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] RBAC: Adding query filter params (interface=admin, service_id=7286f3f75d8a49c587ba776c53d0a75e, region_id=RegionOne) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:33.545266 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.546656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.552476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 522/984] 10.222.0.43 () {56 vars in 1249 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/endpoints?service_id=7286f3f75d8a49c587ba776c53d0a75e&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:33.557869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.587632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2178c-e52f-47f0-be0e-e7a6313e8052 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.621649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.622320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.622610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.622885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.623644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:33.623956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.625321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.637019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 463/985] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:33.642155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.663413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186b8b5-643b-49ee-89ba-19bf6b0f9d3b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.700865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:33.702773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.703678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.704201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.704620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.705455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.707047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.719498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 523/986] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:34:33.750848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b3a2-142f-47bd-be87-5ff8f47a4f4c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.788485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.789319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.789607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.789885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.797530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.799024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:33.814758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:33.816393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:33.822543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 464/987] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:33.823168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:33.847898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:33.936842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe110d-3ac3-4198-8ee9-65cff5c1bc4a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:33.971305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a3fb-1e08-41ea-b0ea-280b7d0e4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:33.972826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a3fb-1e08-41ea-b0ea-280b7d0e4acb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:33.973287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a3fb-1e08-41ea-b0ea-280b7d0e4acb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:33.973719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a3fb-1e08-41ea-b0ea-280b7d0e4acb None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:33.974667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a3fb-1e08-41ea-b0ea-280b7d0e4acb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:33.975172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a3fb-1e08-41ea-b0ea-280b7d0e4acb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:33.976878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a3fb-1e08-41ea-b0ea-280b7d0e4acb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:33.989629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 524/988] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:33.995764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:34.102177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5498c-2bf1-4739-b456-1b86711c069e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:34.118680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:34.138200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55887341-5937-4ab0-b48e-9730cc80365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:34.138877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55887341-5937-4ab0-b48e-9730cc80365c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:34.139192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55887341-5937-4ab0-b48e-9730cc80365c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:34.139480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55887341-5937-4ab0-b48e-9730cc80365c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:34.140329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55887341-5937-4ab0-b48e-9730cc80365c None admin] RBAC: Adding query filter params (role.id=208af3386e9c414cb5d64403e6202f99, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=f9a909447947457d9b14e1369f2d8c93) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:34.140651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55887341-5937-4ab0-b48e-9730cc80365c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:34.142087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55887341-5937-4ab0-b48e-9730cc80365c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:34.148845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 465/989] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:33 2022] GET /identity/v3/role_assignments?user.id=f9a909447947457d9b14e1369f2d8c93&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=208af3386e9c414cb5d64403e6202f99 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:34.455349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966871-c49c-43da-86c8-59d42392bf5b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:34.455723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966871-c49c-43da-86c8-59d42392bf5b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:34.455960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966871-c49c-43da-86c8-59d42392bf5b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:34.457384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 525/990] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:34.462410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f699-b94e-473a-a743-29727631203c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:34.462849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f699-b94e-473a-a743-29727631203c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:34.463064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f699-b94e-473a-a743-29727631203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:34.479545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c453f699-b94e-473a-a743-29727631203c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:34.480735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c453f699-b94e-473a-a743-29727631203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:34.547634 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 466/991] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:34.571224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966871-c49c-43da-86c8-59d42392bf5b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:34.649934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:34.673349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966871-c49c-43da-86c8-59d42392bf5b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:34.716821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:34.717653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:34.717939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:34.718218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:34.718882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:34.720290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:34.732482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:34.733576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:34.739415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 526/992] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:34.740241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453f699-b94e-473a-a743-29727631203c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:34.852293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453f699-b94e-473a-a743-29727631203c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:34.863330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:34.887763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:34.888442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:34.888727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:34.889004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:34.889716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:34.890022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:34.891444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:34.896940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 467/993] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:34.902632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:35.006335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5bbce-b748-4f32-a2ad-2ab8399d3851 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:35.039155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:35.039816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:35.040102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:35.040382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:35.041084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:35.041389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:35.042747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:35.047643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 527/994] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:35.053802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:35.154097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f88f8-ffb1-4c87-ade7-4911addd9d22 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:35.187921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbef5f-047e-45db-80fb-133c92ae12bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:35.188587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbef5f-047e-45db-80fb-133c92ae12bc None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:35.188873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbef5f-047e-45db-80fb-133c92ae12bc None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:35.189150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbef5f-047e-45db-80fb-133c92ae12bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:35.189937 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbef5f-047e-45db-80fb-133c92ae12bc None admin] RBAC: Adding query filter params (interface=public, service_id=dea2fde79177422d8570059d1c7bf544, region_id=RegionOne) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:35.190280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbef5f-047e-45db-80fb-133c92ae12bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:35.191830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbef5f-047e-45db-80fb-133c92ae12bc None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:35.196963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 468/995] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:34:35 2022] GET /identity/v3/endpoints?service_id=dea2fde79177422d8570059d1c7bf544&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:35.202696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:35.212419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:35.306384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca29e6-c1d5-45cf-9b32-2457253c2768 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:35.343449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eabfa-1ea7-4ddd-991a-6dab3ed9e8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:35.344122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eabfa-1ea7-4ddd-991a-6dab3ed9e8b1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:35.344409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eabfa-1ea7-4ddd-991a-6dab3ed9e8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:35.344692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eabfa-1ea7-4ddd-991a-6dab3ed9e8b1 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:35.345375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eabfa-1ea7-4ddd-991a-6dab3ed9e8b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:35.346767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eabfa-1ea7-4ddd-991a-6dab3ed9e8b1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:35.353338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 528/996] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:35 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:34:35.764881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6213c-f0e5-4af7-ac65-4ea3774e87d3 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:35.765411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6213c-f0e5-4af7-ac65-4ea3774e87d3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:35.765411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6213c-f0e5-4af7-ac65-4ea3774e87d3 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:35.766970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 469/997] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:35.771988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b08ad-06df-4d07-bcc9-16c09b198aea None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:35.772295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b08ad-06df-4d07-bcc9-16c09b198aea None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:35.772582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b08ad-06df-4d07-bcc9-16c09b198aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:35.790035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e90b08ad-06df-4d07-bcc9-16c09b198aea None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:35.791259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e90b08ad-06df-4d07-bcc9-16c09b198aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:35.854082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:35.860109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 529/998] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:35.882699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6213c-f0e5-4af7-ac65-4ea3774e87d3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:35.925453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:35.986243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6213c-f0e5-4af7-ac65-4ea3774e87d3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:36.020738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:36.021556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.021846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.022131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.022785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:36.024208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:36.037250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:36.038257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 18:34:36.039532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:36.043086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 470/999] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Jun 20 18:34:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:36.044658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b08ad-06df-4d07-bcc9-16c09b198aea None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:36.142613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b08ad-06df-4d07-bcc9-16c09b198aea None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:36.177013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c517c2-c6ce-4979-937e-8c12a2f8b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:36.177699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c517c2-c6ce-4979-937e-8c12a2f8b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.178028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c517c2-c6ce-4979-937e-8c12a2f8b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.178311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c517c2-c6ce-4979-937e-8c12a2f8b1a0 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.179115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c517c2-c6ce-4979-937e-8c12a2f8b1a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:36.179429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c517c2-c6ce-4979-937e-8c12a2f8b1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:36.180802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c517c2-c6ce-4979-937e-8c12a2f8b1a0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:36.187093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 530/1000] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:36.191212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:36.194516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef93b-f0b9-4a27-a231-366bc7e0e107 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.194815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef93b-f0b9-4a27-a231-366bc7e0e107 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.195133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ef93b-f0b9-4a27-a231-366bc7e0e107 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.196561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 531/1001] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:36.201242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c55c0-f36e-4704-a3ce-a6eb3b0c5b89 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.201539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c55c0-f36e-4704-a3ce-a6eb3b0c5b89 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.201824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c55c0-f36e-4704-a3ce-a6eb3b0c5b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.219779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8e9c55c0-f36e-4704-a3ce-a6eb3b0c5b89 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:36.220951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8e9c55c0-f36e-4704-a3ce-a6eb3b0c5b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:36.286943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:36.297018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 532/1002] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:36.297404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ab54a-9217-45b6-a120-f5696e5970ef None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:36.298962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:36.319504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c55c0-f36e-4704-a3ce-a6eb3b0c5b89 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:36.341791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:36.342617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.342906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.343204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.343914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:36.344228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:36.345588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:36.351301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 471/1003] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Jun 20 18:34:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:36.356625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:36.425695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c55c0-f36e-4704-a3ce-a6eb3b0c5b89 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:36.460836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:36.461713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.462005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.462284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] PATH_INFO: `/v3/services/image` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.462982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:36.464383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:36.466504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806698a0-2ef4-40d2-90ea-aa8ae574a515 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:36.476973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:36.478020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:36.479411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 533/1004] 10.222.0.43 () {56 vars in 1105 bytes} [Mon Jun 20 18:34:36 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:36.488375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:36.505655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:36.506325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.506618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.506900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.507667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:36.509025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:36.525562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 472/1005] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:34:36.561007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:36.609758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740f63-9f0a-47da-835c-5ae99339ed6a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:36.652556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1ae48-4279-4ee2-9401-cb1e8acf6e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:36.653237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ae48-4279-4ee2-9401-cb1e8acf6e3e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.653525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ae48-4279-4ee2-9401-cb1e8acf6e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.653840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ae48-4279-4ee2-9401-cb1e8acf6e3e None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.654561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ae48-4279-4ee2-9401-cb1e8acf6e3e None admin] RBAC: Adding query filter params (name=image) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:36.654879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ae48-4279-4ee2-9401-cb1e8acf6e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:36.656385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ae48-4279-4ee2-9401-cb1e8acf6e3e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:36.667244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 534/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:36.668933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:36.700225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:36.786140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c515e-a1d6-4f2f-8209-201f30d0c013 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:36.820107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2a56e-6743-4d64-8419-3e0d6ebe17f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:36.820884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a56e-6743-4d64-8419-3e0d6ebe17f9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:36.821390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a56e-6743-4d64-8419-3e0d6ebe17f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:36.821934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a56e-6743-4d64-8419-3e0d6ebe17f9 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:36.823287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a56e-6743-4d64-8419-3e0d6ebe17f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:36.823848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a56e-6743-4d64-8419-3e0d6ebe17f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:36.826631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a56e-6743-4d64-8419-3e0d6ebe17f9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:36.839002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 473/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:37.384726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7be4-105a-4f3d-b523-2fbb465fc7db None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:37.385271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7be4-105a-4f3d-b523-2fbb465fc7db None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:37.385271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7be4-105a-4f3d-b523-2fbb465fc7db None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:37.386788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 535/1008] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:37.391688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9b42-29d7-41db-8a72-a0b2860cb082 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:37.391982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9b42-29d7-41db-8a72-a0b2860cb082 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:37.392264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9b42-29d7-41db-8a72-a0b2860cb082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:37.409399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-650f9b42-29d7-41db-8a72-a0b2860cb082 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:37.410564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-650f9b42-29d7-41db-8a72-a0b2860cb082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:37.479000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 474/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:37.501628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7be4-105a-4f3d-b523-2fbb465fc7db None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:37.603260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7be4-105a-4f3d-b523-2fbb465fc7db None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:37.620738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:37.638681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:37.639453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:37.639741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:37.640023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:37.640681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:37.642049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:37.654532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:37.655651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:37.662154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 536/1010] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:37.663013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9b42-29d7-41db-8a72-a0b2860cb082 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:37.684104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:37.774431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9b42-29d7-41db-8a72-a0b2860cb082 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:37.808357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:37.809059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:37.809313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:37.809592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:37.810302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] RBAC: Adding query filter params (name=compute) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:37.810615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:37.812010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:37.821427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 475/1011] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:37.822228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:37.922565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d69d9-44a6-4a17-8ef5-ef9e55121104 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:37.957771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449247fc-f93c-4935-9cc3-9c5f8a848be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:37.958449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449247fc-f93c-4935-9cc3-9c5f8a848be6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:37.958740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449247fc-f93c-4935-9cc3-9c5f8a848be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:37.959054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449247fc-f93c-4935-9cc3-9c5f8a848be6 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:37.959771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449247fc-f93c-4935-9cc3-9c5f8a848be6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:37.960082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449247fc-f93c-4935-9cc3-9c5f8a848be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:37.961453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449247fc-f93c-4935-9cc3-9c5f8a848be6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:37.970892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 537/1012] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Jun 20 18:34:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:37.972964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:38.056169 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:38.073422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a14af-8202-4d35-82c2-0f9b8fdbbfbb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:38.106971 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4a6f-3b46-4364-abee-f3319c23be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:38.107695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4a6f-3b46-4364-abee-f3319c23be08 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:38.107983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4a6f-3b46-4364-abee-f3319c23be08 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:38.108317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4a6f-3b46-4364-abee-f3319c23be08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:38.109075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4a6f-3b46-4364-abee-f3319c23be08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:38.110436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4a6f-3b46-4364-abee-f3319c23be08 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:38.138956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 476/1013] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:38.597550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb489d-98d0-47a8-8732-e5eda51a5fc5 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:38.598105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb489d-98d0-47a8-8732-e5eda51a5fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:38.598105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb489d-98d0-47a8-8732-e5eda51a5fc5 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:38.599577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 538/1014] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:38.604724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8725-196f-4cb9-9cd1-5bca95c4914b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:38.605027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8725-196f-4cb9-9cd1-5bca95c4914b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:38.605314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8725-196f-4cb9-9cd1-5bca95c4914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:38.621938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-276f8725-196f-4cb9-9cd1-5bca95c4914b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:38.623148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-276f8725-196f-4cb9-9cd1-5bca95c4914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:38.701286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 477/1015] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:38.725290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb489d-98d0-47a8-8732-e5eda51a5fc5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:38.776454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:38.832708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb489d-98d0-47a8-8732-e5eda51a5fc5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:38.846087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7300f2-ac33-467e-8a85-80045e081e4d None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:38.846587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7300f2-ac33-467e-8a85-80045e081e4d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:38.846747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7300f2-ac33-467e-8a85-80045e081e4d None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:38.848411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 478/1016] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:38.853066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e47c1-4f08-452d-9cfc-01413c59d65a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:38.853378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e47c1-4f08-452d-9cfc-01413c59d65a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:38.853815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e47c1-4f08-452d-9cfc-01413c59d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:38.869945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:38.870594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a61e47c1-4f08-452d-9cfc-01413c59d65a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:38.870790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:38.871080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:38.871369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:38.871800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a61e47c1-4f08-452d-9cfc-01413c59d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:38.872690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:38.874325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:38.876678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 539/1017] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:38.883544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:38.938749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:38.949759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 479/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:38.972141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e47c1-4f08-452d-9cfc-01413c59d65a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:38.992479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb383ed-cd50-4566-b4e0-ccdb04e1574f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:39.007330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:39.028932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9064156-699a-42f7-96b8-5a73d3241ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:39.029596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064156-699a-42f7-96b8-5a73d3241ea7 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:39.029884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064156-699a-42f7-96b8-5a73d3241ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:39.030162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064156-699a-42f7-96b8-5a73d3241ea7 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:39.030866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9064156-699a-42f7-96b8-5a73d3241ea7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:39.032583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9064156-699a-42f7-96b8-5a73d3241ea7 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:39.060480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 540/1019] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:38 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:34:39.086040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e47c1-4f08-452d-9cfc-01413c59d65a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:39.125008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2196593-8d84-44db-8724-2a190dd52f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:39.125617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196593-8d84-44db-8724-2a190dd52f82 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:39.125909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196593-8d84-44db-8724-2a190dd52f82 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:39.126195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196593-8d84-44db-8724-2a190dd52f82 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:39.127012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2196593-8d84-44db-8724-2a190dd52f82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:39.128628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2196593-8d84-44db-8724-2a190dd52f82 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:39.150943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 480/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:34:38 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:34:40.243297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310f0c-36c1-41bb-bab6-52065527ce1b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:40.243845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310f0c-36c1-41bb-bab6-52065527ce1b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:40.243845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db310f0c-36c1-41bb-bab6-52065527ce1b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:40.245406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 541/1021] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:40.250363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e94a5-4eab-4228-a07b-263f84dcedef None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:40.250773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e94a5-4eab-4228-a07b-263f84dcedef None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:40.250979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e94a5-4eab-4228-a07b-263f84dcedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:40.269975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b36e94a5-4eab-4228-a07b-263f84dcedef None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:40.271204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b36e94a5-4eab-4228-a07b-263f84dcedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:40.323121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:40.347445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 481/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:40.370984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310f0c-36c1-41bb-bab6-52065527ce1b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:40.472537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db310f0c-36c1-41bb-bab6-52065527ce1b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:40.506418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:40.507208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:40.507534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:40.507855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:40.517803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:40.526047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:40.527255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:40.528141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:40.529237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 542/1023] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Jun 20 18:34:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:40.533458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e94a5-4eab-4228-a07b-263f84dcedef None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:40.635987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e94a5-4eab-4228-a07b-263f84dcedef None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:40.670818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:40.671898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:40.672393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:40.672876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:40.673843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:40.674884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:40.676471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:40.684783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 482/1024] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Jun 20 18:34:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:40.690622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:40.725539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:40.812015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f45c-d482-4d33-8252-b2cb8c39e079 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:40.846126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:40.846953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:40.847244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:40.847519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:40.858024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:40.859503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:40.876342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:40.877312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:40.878757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:40.878757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:40.878757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:40.878757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:40.878757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 543/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:40.883678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:40.930296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:40.985867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bd8e3-9b57-487b-9593-17efad323037 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.019541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0a565-66d4-4a47-8d27-4ad834dd53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.020218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0a565-66d4-4a47-8d27-4ad834dd53d5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.020509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0a565-66d4-4a47-8d27-4ad834dd53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.020790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0a565-66d4-4a47-8d27-4ad834dd53d5 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.021517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0a565-66d4-4a47-8d27-4ad834dd53d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:41.021827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0a565-66d4-4a47-8d27-4ad834dd53d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.023216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0a565-66d4-4a47-8d27-4ad834dd53d5 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.035787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 483/1026] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:41.041184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.124101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.148239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c9abe-5cb0-46f4-b695-b1f2030673ff None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.153105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2324-f361-4b2d-b7a6-aac277e8cc7b None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.153400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2324-f361-4b2d-b7a6-aac277e8cc7b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.153683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2324-f361-4b2d-b7a6-aac277e8cc7b None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.155268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 484/1027] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:41.160915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10673a11-b02d-489f-ba99-8de73b6def36 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.161212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10673a11-b02d-489f-ba99-8de73b6def36 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.161497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10673a11-b02d-489f-ba99-8de73b6def36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.177772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-10673a11-b02d-489f-ba99-8de73b6def36 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:41.178988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-10673a11-b02d-489f-ba99-8de73b6def36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:41.184812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029aac6-6548-4fb4-a951-f12a89b2e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.185620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029aac6-6548-4fb4-a951-f12a89b2e865 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.185909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029aac6-6548-4fb4-a951-f12a89b2e865 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.186188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029aac6-6548-4fb4-a951-f12a89b2e865 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.197092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029aac6-6548-4fb4-a951-f12a89b2e865 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.198567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029aac6-6548-4fb4-a951-f12a89b2e865 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-e029aac6-6548-4fb4-a951-f12a89b2e865 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:41.213509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:41.214671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 544/1028] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:41.215976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c1692-629f-44df-9ec8-5d6a1ea4866f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.216656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c1692-629f-44df-9ec8-5d6a1ea4866f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.216656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c1692-629f-44df-9ec8-5d6a1ea4866f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.217723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 545/1029] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:41.222732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c1692-629f-44df-9ec8-5d6a1ea4866f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.252487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 485/1030] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:41.253589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241606-a4af-447c-9b58-765b23abb104 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.253886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241606-a4af-447c-9b58-765b23abb104 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.254166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241606-a4af-447c-9b58-765b23abb104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.270277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1d241606-a4af-447c-9b58-765b23abb104 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:41.271474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1d241606-a4af-447c-9b58-765b23abb104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:41.298243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.325241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c1692-629f-44df-9ec8-5d6a1ea4866f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.337015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 486/1031] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:41.337834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d241606-a4af-447c-9b58-765b23abb104 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.361110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.361909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.362302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.362681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.363668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:41.364010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.365452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.373402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.383983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 546/1032] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:41.384803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.440232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d241606-a4af-447c-9b58-765b23abb104 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.474178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.475251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.475538 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.475816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.477038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.478488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.480283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 487/1033] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:41.480871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.488811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46594dc7-2840-44f8-a4a4-f325db9f5042 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.510733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.523513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.524310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.524593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.524871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] PATH_INFO: `/v3/services/image` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.525527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.526888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:41.538562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:41.539710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:41.540588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 547/1034] 10.222.0.43 () {56 vars in 1105 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:41.541624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.586841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a97eb-6a22-4ec6-9ad6-869ef11a7dd7 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.600020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.621423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.622082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.622371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.622660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.640690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d598c-ade2-41ae-b2aa-2fb70227a824 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.673636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.674319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.675193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.675506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.676229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.677647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.689190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.690708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.697252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 548/1035] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:34:41 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:41.698269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.736314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.818475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 488/1036] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:34:41.819958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.821015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a751c-ba3e-49ae-bd8c-07aa99de4717 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.838426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.863195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.864702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.864702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.864702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.865288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] RBAC: Adding query filter params (name=image) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:41.865618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.867034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.872951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 549/1037] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:41.879137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:41.933789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59776457-2816-4d79-802b-8e8bcf7210e2 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:41.962761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:41.969434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:41.970977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:41.971512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:41.972412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:41.987081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:41.989762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:41.994656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4312f-892d-452b-ac23-1e2b7d68cba0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:42.008275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:42.009423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:42.010522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:42.010522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:42.010522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:42.010522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:42.014231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 489/1038] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:42.015107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:42.035633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:42.036326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:42.036683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:42.037001 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:42.037751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:42.038085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:42.039494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:42.044855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 550/1039] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:42.050687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:42.099741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:42.128071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae2f8-392e-47fd-87db-cad7d4054eec None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:42.155721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260bd6-eb49-41d1-a31c-072be6d6a6d1 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:42.164400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:42.165377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:42.165816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:42.166372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:42.167136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:42.167452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:42.168821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:42.181689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 490/1040] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:42.187044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:42.191245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:42.191926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:42.192215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:42.192499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:42.193304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] RBAC: Adding query filter params (interface=public, service_id=ed3c0a6062e84c44b823155b551f2179, region_id=RegionOne) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:42.193621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:42.195017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:42.204599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 551/1041] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:34:42 2022] GET /identity/v3/endpoints?service_id=ed3c0a6062e84c44b823155b551f2179&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:42.206272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:42.239130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:42.302446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b75af-b982-49cd-ab65-e34a2212cd24 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:42.314535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ac152-ce28-45e0-9185-aff805250a7d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:42.323802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:42.343329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:42.344245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:42.344635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:42.344923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:42.350257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:42.350950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:42.351239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:42.351524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:42.352120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:42.352220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:42.353556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:42.353656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:42.360056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 552/1042] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:34:42 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:42.369056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:42.370060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:42.371484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:42.372692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 491/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:42.378824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:42.491357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096394e-a162-471e-9499-d49b1dd8363d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:42.528865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee61a6d-6839-4d57-8dd5-8cd9afcac021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:42.529540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee61a6d-6839-4d57-8dd5-8cd9afcac021 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:42.529828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee61a6d-6839-4d57-8dd5-8cd9afcac021 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:42.530108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee61a6d-6839-4d57-8dd5-8cd9afcac021 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:42.530923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee61a6d-6839-4d57-8dd5-8cd9afcac021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:42.531252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee61a6d-6839-4d57-8dd5-8cd9afcac021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:42.532939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee61a6d-6839-4d57-8dd5-8cd9afcac021 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:42.546558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 553/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:42.553038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:42.653302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711871cd-b910-4945-a88e-43272fc5508d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:42.655621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:42.688606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770af70-c945-46cd-9dfc-563aa5fdca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:42.689276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770af70-c945-46cd-9dfc-563aa5fdca2a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:42.689566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770af70-c945-46cd-9dfc-563aa5fdca2a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:42.689851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770af70-c945-46cd-9dfc-563aa5fdca2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:42.691265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770af70-c945-46cd-9dfc-563aa5fdca2a None admin] RBAC: Adding query filter params (role.id=208af3386e9c414cb5d64403e6202f99, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=87a7fb173c0e439290808a6f9e1616f2) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:42.691585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770af70-c945-46cd-9dfc-563aa5fdca2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:42.693024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770af70-c945-46cd-9dfc-563aa5fdca2a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:42.711112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 492/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:42 2022] GET /identity/v3/role_assignments?user.id=87a7fb173c0e439290808a6f9e1616f2&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=208af3386e9c414cb5d64403e6202f99 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:43.789521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33c908-e2d1-441c-9def-e30691017024 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:43.790038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33c908-e2d1-441c-9def-e30691017024 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:43.790163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33c908-e2d1-441c-9def-e30691017024 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:43.791642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 554/1046] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:43.796825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75391a-f131-4ea2-87d8-12c79e8e1206 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:43.797238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75391a-f131-4ea2-87d8-12c79e8e1206 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:43.797396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75391a-f131-4ea2-87d8-12c79e8e1206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:43.813758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7c75391a-f131-4ea2-87d8-12c79e8e1206 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:43.815491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7c75391a-f131-4ea2-87d8-12c79e8e1206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:43.883816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 493/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:43.907760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33c908-e2d1-441c-9def-e30691017024 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:43.938641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.011648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33c908-e2d1-441c-9def-e30691017024 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.045246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.046050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.046335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.046611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.056627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:44.064352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:44.065763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:44.066621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:44.073999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 555/1048] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:44.074130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75391a-f131-4ea2-87d8-12c79e8e1206 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.167445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.172368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75391a-f131-4ea2-87d8-12c79e8e1206 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.206668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d2e7d-7936-47b3-93d1-ba201e2f43c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.207384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d2e7d-7936-47b3-93d1-ba201e2f43c3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.207672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d2e7d-7936-47b3-93d1-ba201e2f43c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.207952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d2e7d-7936-47b3-93d1-ba201e2f43c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.208708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d2e7d-7936-47b3-93d1-ba201e2f43c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:44.209020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d2e7d-7936-47b3-93d1-ba201e2f43c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:44.210387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d2e7d-7936-47b3-93d1-ba201e2f43c3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:44.218838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 494/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:44.224453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.315853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.325748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bf3af-1c3c-45fb-bebc-b14c3f977ac7 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.359973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.360866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.361153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.361430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] PATH_INFO: `/v3/users/708cd55b71094e11af1dd75c1b1aa10d` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.375059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] RBAC: Authorizing `identity:get_user(user_id=708cd55b71094e11af1dd75c1b1aa10d)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:44.376508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:44.378396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 556/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/users/708cd55b71094e11af1dd75c1b1aa10d => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:44.382113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98656-19a5-4013-a01f-13e669ef992f None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.382409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98656-19a5-4013-a01f-13e669ef992f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.383027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98656-19a5-4013-a01f-13e669ef992f None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.383698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.384571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 495/1051] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:44.389394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215a17-d171-44c3-ad06-937dac422e1c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.389688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215a17-d171-44c3-ad06-937dac422e1c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.389973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215a17-d171-44c3-ad06-937dac422e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.407186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-52215a17-d171-44c3-ad06-937dac422e1c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:44.408364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-52215a17-d171-44c3-ad06-937dac422e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:44.475426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 496/1052] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:44.487262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f4a0d-ae20-44bd-b7e6-1edb71162008 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.498079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52215a17-d171-44c3-ad06-937dac422e1c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.523027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677f392-b3b2-41fd-a637-ce9c6612bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.523692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f392-b3b2-41fd-a637-ce9c6612bf67 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.523984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f392-b3b2-41fd-a637-ce9c6612bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.524274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f392-b3b2-41fd-a637-ce9c6612bf67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.545203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.593903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.598639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677f392-b3b2-41fd-a637-ce9c6612bf67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:44.600126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677f392-b3b2-41fd-a637-ce9c6612bf67 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:44.605200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52215a17-d171-44c3-ad06-937dac422e1c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.641906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.643145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.643557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.644159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] PATH_INFO: `/v3/services/image` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.644830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:44.646195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:44.659208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:44.660226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:44.661114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 497/1053] 10.222.0.43 () {56 vars in 1105 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:44.666238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.715369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 557/1054] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 18:34:44.715369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a89c8-f4b5-4536-9df1-2bec6005b6fa None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.715369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a89c8-f4b5-4536-9df1-2bec6005b6fa None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.715369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a89c8-f4b5-4536-9df1-2bec6005b6fa None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.715369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 558/1055] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:44.717320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a89c8-f4b5-4536-9df1-2bec6005b6fa None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.766759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.776154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c9fa-bccf-476e-8e2e-0ca7f87ee512 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.817077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e277-899c-437b-a4e8-9f11d4e9ef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.817736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a89c8-f4b5-4536-9df1-2bec6005b6fa None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.818097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e277-899c-437b-a4e8-9f11d4e9ef0f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.818097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e277-899c-437b-a4e8-9f11d4e9ef0f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.818301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e277-899c-437b-a4e8-9f11d4e9ef0f None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.819040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e277-899c-437b-a4e8-9f11d4e9ef0f None admin] RBAC: Adding query filter params (name=image) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:44.819356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e277-899c-437b-a4e8-9f11d4e9ef0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:44.820736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e277-899c-437b-a4e8-9f11d4e9ef0f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:44.825687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 498/1056] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:44.826852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f018456-634d-49b5-8c8f-7b30b1ce3eb4 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.827175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f018456-634d-49b5-8c8f-7b30b1ce3eb4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.827459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f018456-634d-49b5-8c8f-7b30b1ce3eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.843986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6f018456-634d-49b5-8c8f-7b30b1ce3eb4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:44.845104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6f018456-634d-49b5-8c8f-7b30b1ce3eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:44.852210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.853072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:44.853354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:44.853628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:44.854780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] RBAC: Authorizing `identity:get_project(project_id=c67cd052f63842c7bcd83a59ff872848)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:44.856230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:44.857910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 559/1057] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:44.858655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.865515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.912378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 499/1058] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:44.913296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f018456-634d-49b5-8c8f-7b30b1ce3eb4 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:44.965283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67309f4-7ba0-4854-89af-6e3afff553ed None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:44.982009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:44.999123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:44.999797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.000090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.000371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.001080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:45.001391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:45.002858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:45.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 560/1059] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:45.015502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:45.020309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f018456-634d-49b5-8c8f-7b30b1ce3eb4 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:45.055420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:45.056112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.056397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.056677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.057504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=c67cd052f63842c7bcd83a59ff872848, user.id=708cd55b71094e11af1dd75c1b1aa10d) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:45.057816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:45.059267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:45.064635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 500/1060] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:44 2022] GET /identity/v3/role_assignments?user.id=708cd55b71094e11af1dd75c1b1aa10d&scope.project.id=c67cd052f63842c7bcd83a59ff872848&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:45.065410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:45.081636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:45.120842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e78000-d3b5-4d90-8786-91e8c4cb5ad3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:45.162084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:45.163275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.163754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.164217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.176559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:45.181684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d34b-150d-42d9-bd17-95ed7fffefbd None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:45.186196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:45.187263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:45.188121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:45.194321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 561/1061] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Jun 20 18:34:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:45.195013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:45.220944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:45.221696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.221983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.222257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.223032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:45.224400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:45.244160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:45.258957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 501/1062] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:34:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:34:45.310682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d839b6-aa5d-4496-b09d-ed562f140af3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:45.354638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:45.355360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.355655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.355937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.356706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:45.357018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:45.358422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:45.372849 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 562/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Jun 20 18:34:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:45.374382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:45.448204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:45.485031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f96b8-f84e-41d7-aa03-3c3c55bf2ec4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:45.519797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:45.520604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.520891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.521168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.532049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:45.533480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:45.552249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:45.553193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:45.554182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:45.554182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:45.554182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:45.554182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:45.554182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 502/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:45.559189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:45.658212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:45.661173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246003b9-50f9-43dd-b84e-e012732a69a9 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:45.699416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:45.700096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.700381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.700663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.701397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:45.701710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:45.703111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:45.718975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 563/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:45.720766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:45.825856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a227c-2cc7-40d1-9277-fde9b5ff8cc0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:45.844993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:45.859701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:45.860499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:45.860787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:45.861065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:45.868840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:45.870269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:45.883861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:45.884943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:45.886120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 503/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:34:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:45.892467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:45.993003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce2e9-0d4e-49f6-9f1b-9ca9de93939d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:46.026961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:46.027651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:46.027937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:46.028218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:46.029054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:46.029366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:46.030794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:46.050316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 564/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:34:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:46.055648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:46.155759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dec2e-050d-4975-b472-c58d38935ee4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:46.190743 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:46.191576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:46.191861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:46.192139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:46.202532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:46.204001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:46.220679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:46.222079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:46.223033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:46.223033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:46.223033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:46.223033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:46.224012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 504/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:46.228132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:46.247823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:46.327235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81f6ad-27d7-4ca2-9be9-2e5ab6946e71 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:46.361641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:46.362411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:46.362701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:46.363012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:46.363743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:46.364054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:46.365442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:46.382175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 565/1069] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:46.383721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:46.419064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:46.489613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90377-b4cd-4c3c-b429-62498647aa93 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:46.522613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:46.523369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:46.523657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:46.523933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:46.530611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:46.532349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:46.547044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:46.547930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:46.548837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 505/1070] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:46.555799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:46.635235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:46.658314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158f9ec-0068-4643-b6d9-19dcea88d33c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:46.692254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34e77-72ed-4b90-96b9-e9ab170c9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:46.692925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34e77-72ed-4b90-96b9-e9ab170c9e2d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:46.693211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34e77-72ed-4b90-96b9-e9ab170c9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:46.693488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34e77-72ed-4b90-96b9-e9ab170c9e2d None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:46.694275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34e77-72ed-4b90-96b9-e9ab170c9e2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:46.694586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34e77-72ed-4b90-96b9-e9ab170c9e2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:46.698256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34e77-72ed-4b90-96b9-e9ab170c9e2d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:46.714975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 566/1071] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:46.717155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:46.811269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:46.821912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09f11a-81a9-4c45-8a03-ad87339b8cb3 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:46.856111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ee682-672c-4009-877d-4d8709d052bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:46.857021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ee682-672c-4009-877d-4d8709d052bb None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:46.857311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ee682-672c-4009-877d-4d8709d052bb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:46.857592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ee682-672c-4009-877d-4d8709d052bb None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/87a7fb173c0e439290808a6f9e1616f2/roles/208af3386e9c414cb5d64403e6202f99` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:46.859832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ee682-672c-4009-877d-4d8709d052bb None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=87a7fb173c0e439290808a6f9e1616f2, role_id=208af3386e9c414cb5d64403e6202f99)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:46.861263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ee682-672c-4009-877d-4d8709d052bb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:46.875647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 506/1072] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:34:46 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/87a7fb173c0e439290808a6f9e1616f2/roles/208af3386e9c414cb5d64403e6202f99 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:34:47.082828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61ff1-197c-43eb-89e2-de3393b31d88 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.083365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61ff1-197c-43eb-89e2-de3393b31d88 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.083365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61ff1-197c-43eb-89e2-de3393b31d88 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.084871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 567/1073] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:47.090008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c67a97-42c1-4f2d-86be-3d3c17ea1046 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.090410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c67a97-42c1-4f2d-86be-3d3c17ea1046 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.090773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c67a97-42c1-4f2d-86be-3d3c17ea1046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.107941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d4c67a97-42c1-4f2d-86be-3d3c17ea1046 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:47.109132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d4c67a97-42c1-4f2d-86be-3d3c17ea1046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:47.179292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 507/1074] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:47.201687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61ff1-197c-43eb-89e2-de3393b31d88 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:47.304847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61ff1-197c-43eb-89e2-de3393b31d88 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:47.318064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552e56-dcca-4e2f-ad2a-acacd9a39d5a None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.318354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552e56-dcca-4e2f-ad2a-acacd9a39d5a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.318640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552e56-dcca-4e2f-ad2a-acacd9a39d5a None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.320175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 508/1075] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:47.326364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7563b-91ff-4759-b74a-66eccc15fbec None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.326364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7563b-91ff-4759-b74a-66eccc15fbec None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.326364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7563b-91ff-4759-b74a-66eccc15fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.341482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:47.342229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.342523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.342828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.343842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e6d7563b-91ff-4759-b74a-66eccc15fbec None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:47.345087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e6d7563b-91ff-4759-b74a-66eccc15fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:47.351010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:47.359431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:47.367947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:47.368903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:47.369770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 568/1076] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:47.375113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:47.433437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 509/1077] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:47.456649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7563b-91ff-4759-b74a-66eccc15fbec None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:47.470677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:47.500000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412732c-1dc3-4062-87fa-1c70455e1388 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:47.540917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:47.541590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.541877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.542154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.542897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:47.543246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:47.544609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:47.558505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 569/1078] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:47.559676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:47.572637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7563b-91ff-4759-b74a-66eccc15fbec None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:47.607019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9c040-871e-4231-b873-15871a53726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:47.607597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9c040-871e-4231-b873-15871a53726a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.607885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9c040-871e-4231-b873-15871a53726a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.608175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9c040-871e-4231-b873-15871a53726a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.619758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:47.661901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ba3a-47bd-46c2-8af1-2e48f84701eb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:47.680504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9c040-871e-4231-b873-15871a53726a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:47.681987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9c040-871e-4231-b873-15871a53726a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:47.696539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:47.698650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:47.702253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.702253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.702253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] PATH_INFO: `/v3/users/708cd55b71094e11af1dd75c1b1aa10d` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.702253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] RBAC: Authorizing `identity:get_user(user_id=708cd55b71094e11af1dd75c1b1aa10d)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:47.702940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:47.709445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 570/1079] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:34:47 2022] GET /identity/v3/users/708cd55b71094e11af1dd75c1b1aa10d => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:47.710067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:47.795586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 510/1080] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 18:34:47.801556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9c040-871e-4231-b873-15871a53726a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:47.817090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a74b9-3241-4e37-973d-ad6c936521ba None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:47.845740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:47.855287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:47.856215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.856505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.856904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.858217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=c67cd052f63842c7bcd83a59ff872848)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:47.859732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:47.861540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 571/1081] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:34:47 2022] GET /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:47.867769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:47.901912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9c040-871e-4231-b873-15871a53726a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:47.915587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:47.937734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:47.938544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:47.938832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:47.939147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:47.949765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:47.951249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:47.970246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:47.972126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:47.973061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:47.973061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:47.973061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:47.973061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:47.973061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 511/1082] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:47.973352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dede1b4-d7cc-4c68-8c55-deb8b5d97cf5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:47.978183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:48.012703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ed0aa-4ae6-4e8f-a607-4a003f51f89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:48.013730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ed0aa-4ae6-4e8f-a607-4a003f51f89b None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:48.014091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ed0aa-4ae6-4e8f-a607-4a003f51f89b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:48.014446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ed0aa-4ae6-4e8f-a607-4a003f51f89b None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848/users/708cd55b71094e11af1dd75c1b1aa10d/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:48.016547 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ed0aa-4ae6-4e8f-a607-4a003f51f89b None admin] RBAC: Authorizing `identity:create_grant(project_id=c67cd052f63842c7bcd83a59ff872848, user_id=708cd55b71094e11af1dd75c1b1aa10d, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:48.018603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ed0aa-4ae6-4e8f-a607-4a003f51f89b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:48.042943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 572/1083] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:34:47 2022] PUT /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848/users/708cd55b71094e11af1dd75c1b1aa10d/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:34:48.100813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f37428-e40b-4201-863d-d1a7d31dc43d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:48.139270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1b653-e513-47de-a911-901ada2b9615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:48.139877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1b653-e513-47de-a911-901ada2b9615 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:48.140172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1b653-e513-47de-a911-901ada2b9615 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:48.140459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1b653-e513-47de-a911-901ada2b9615 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:48.141204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1b653-e513-47de-a911-901ada2b9615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:48.141520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1b653-e513-47de-a911-901ada2b9615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:48.142973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1b653-e513-47de-a911-901ada2b9615 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:48.155513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 512/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:48.901845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eb812-a0df-469f-aa73-2fc2b877d229 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:48.902436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eb812-a0df-469f-aa73-2fc2b877d229 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:48.902436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eb812-a0df-469f-aa73-2fc2b877d229 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:48.903826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 573/1085] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:48.910486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef458bdf-c685-4eba-bda9-e686421cfd28 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:48.910895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef458bdf-c685-4eba-bda9-e686421cfd28 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:48.911105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef458bdf-c685-4eba-bda9-e686421cfd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:48.927699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ef458bdf-c685-4eba-bda9-e686421cfd28 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:48.928873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ef458bdf-c685-4eba-bda9-e686421cfd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:48.945477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:48.993978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 513/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:49.017406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eb812-a0df-469f-aa73-2fc2b877d229 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:49.073365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:49.118252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eb812-a0df-469f-aa73-2fc2b877d229 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:49.153749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:49.154570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:49.154855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:49.155163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:49.165373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:49.173558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:49.174492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:49.175687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 574/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Jun 20 18:34:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:49.180638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef458bdf-c685-4eba-bda9-e686421cfd28 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:49.275280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef458bdf-c685-4eba-bda9-e686421cfd28 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:49.307681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:49.308345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:49.308629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:49.308907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:49.309650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:49.309956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:49.311337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:49.319537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 514/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Jun 20 18:34:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:49.325093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:49.423590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fb5de-a3a7-4659-b707-2995eb8316e0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:49.439351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:49.457686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:49.458488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:49.458778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:49.459091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:49.469334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:49.470778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:49.487903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:49.488813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:49.489710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:49.489710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:49.489710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:49.489710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:49.489710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 575/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:49.494706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:49.513187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:49.593220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7423ee-3fed-4c5d-8db0-f33e8bf524e1 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:49.625426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:49.626095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:49.626384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:49.626662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:49.627952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:49.628266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:49.629636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:49.641341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 515/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:49.646826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:49.745215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3fcca-7ad5-418c-b090-2124fbd5ecdc None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:49.778479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:49.779312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:49.779604 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:49.779887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:49.788808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:49.790247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:34:49.804725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:49.805672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:49.806625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 576/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Jun 20 18:34:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:34:49.811595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:49.885902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:49.909897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529fba-ac4f-476e-8843-5bdad51f218f None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:49.943620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd4b23-a025-49ef-8ff2-fc55900bb303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:49.944296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd4b23-a025-49ef-8ff2-fc55900bb303 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:49.944582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd4b23-a025-49ef-8ff2-fc55900bb303 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:49.944857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd4b23-a025-49ef-8ff2-fc55900bb303 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:49.945690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd4b23-a025-49ef-8ff2-fc55900bb303 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:49.946005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd4b23-a025-49ef-8ff2-fc55900bb303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:49.947465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd4b23-a025-49ef-8ff2-fc55900bb303 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:49.964269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 516/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Jun 20 18:34:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:49.969856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:49.998537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.068966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7766140-227d-4518-983e-642d4ad65797 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.072647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580e748-e042-495b-8f8e-1e796a812099 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.072943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580e748-e042-495b-8f8e-1e796a812099 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.073231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580e748-e042-495b-8f8e-1e796a812099 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.074610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 517/1093] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:34:50.079443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45ee6-caf7-4dc8-a249-3baa01f29921 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.079739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45ee6-caf7-4dc8-a249-3baa01f29921 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.080028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45ee6-caf7-4dc8-a249-3baa01f29921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.096485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-22a45ee6-caf7-4dc8-a249-3baa01f29921 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:50.097694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-22a45ee6-caf7-4dc8-a249-3baa01f29921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:50.102171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.102828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.103147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.103431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.163565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 518/1094] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:34:50.169916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.171404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.187023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45ee6-caf7-4dc8-a249-3baa01f29921 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.197095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.247632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.269242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 577/1095] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 18:34:50.274874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.289361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45ee6-caf7-4dc8-a249-3baa01f29921 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.323263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.324073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.324366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.324653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.335119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:34:50.342767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:50.343770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:34:50.344772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 519/1096] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:50.349764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.372562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b716f19-483d-4d43-9508-d000b696fc1c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.398582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.407024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.407832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.408126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.408410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.418391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.419816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:34:50.437595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:50.438671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:50.439631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:34:50.439631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:34:50.439631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:34:50.439631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:50.439631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 578/1097] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:50.444335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.447513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a0fc4-d154-4259-aea5-6eb628961987 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.472870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.483569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.484447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.484911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.485358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.487259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:50.487259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.487824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.496455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 520/1098] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:50.502104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.545434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c5a82-5057-489b-a191-4ca17068de55 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.578894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.579587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.579870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.580151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.580942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:50.581252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.582646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.593683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 579/1099] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:50.599693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.601934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced155-89c2-443f-a0f2-5bbc9e40796d None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.636836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.637714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.638005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.638287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] PATH_INFO: `/v3/users/708cd55b71094e11af1dd75c1b1aa10d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.639500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] RBAC: Authorizing `identity:get_user(user_id=708cd55b71094e11af1dd75c1b1aa10d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.640013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.640929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.643118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 521/1100] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/users/708cd55b71094e11af1dd75c1b1aa10d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:50.651160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.701251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e08a1-4082-46fc-831f-d9e36c81e747 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.706230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.736818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.737618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.737905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.738186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.744824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.746263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.750070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135c632-46f7-44d0-8b8d-436f56da5e04 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:34:50.760760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:34:50.761815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:34:50.762952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 580/1101] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:34:50.767714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.786181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.786842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.787173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.787455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.852777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.854241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.864101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.867363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb5b3a-0971-4b05-bd1d-8249d1cbba60 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:50.901416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:50.902286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:50.902581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:50.902862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:50.903689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:50.904007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:50.905436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:50.907776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:50.924031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 581/1102] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:50.930611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:50.952988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 522/1103] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 18:34:50.958548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:51.028183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f528b11-1478-4177-8bba-86427acf4d97 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:51.053811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8e07-59b4-489b-b159-d0613ae0ef4a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:51.061154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:51.061807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:51.062093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:51.062372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:51.063228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] RBAC: Adding query filter params (role.id=208af3386e9c414cb5d64403e6202f99, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=87a7fb173c0e439290808a6f9e1616f2) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:51.063538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:51.064997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:51.070671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 582/1104] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/role_assignments?user.id=87a7fb173c0e439290808a6f9e1616f2&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=208af3386e9c414cb5d64403e6202f99 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:51.093979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cacd1-fc6b-4fe2-bf01-4e37c9c9442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:51.094886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cacd1-fc6b-4fe2-bf01-4e37c9c9442d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:51.095203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cacd1-fc6b-4fe2-bf01-4e37c9c9442d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:51.095482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cacd1-fc6b-4fe2-bf01-4e37c9c9442d None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:51.096842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cacd1-fc6b-4fe2-bf01-4e37c9c9442d None admin] RBAC: Authorizing `identity:get_project(project_id=c67cd052f63842c7bcd83a59ff872848)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:51.098332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cacd1-fc6b-4fe2-bf01-4e37c9c9442d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:51.100175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 523/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:34:50 2022] GET /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:34:51.106453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:51.134659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:51.212462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6c527-3dd0-41d2-9913-3d209e36e9ba None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:51.248069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a71770-13df-457a-99fc-7a97f5e7f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:51.248736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71770-13df-457a-99fc-7a97f5e7f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:51.249028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71770-13df-457a-99fc-7a97f5e7f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:51.249311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71770-13df-457a-99fc-7a97f5e7f0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:51.250153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a71770-13df-457a-99fc-7a97f5e7f0c8 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=c67cd052f63842c7bcd83a59ff872848, user.id=708cd55b71094e11af1dd75c1b1aa10d) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:51.250470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a71770-13df-457a-99fc-7a97f5e7f0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:51.251927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a71770-13df-457a-99fc-7a97f5e7f0c8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:51.257835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 583/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:51 2022] GET /identity/v3/role_assignments?user.id=708cd55b71094e11af1dd75c1b1aa10d&scope.project.id=c67cd052f63842c7bcd83a59ff872848&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:53.334431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3648c67-dff1-48eb-b176-57389bda58cf None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:53.335003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3648c67-dff1-48eb-b176-57389bda58cf None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:53.335106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3648c67-dff1-48eb-b176-57389bda58cf None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:53.336398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 524/1107] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:53.341589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09949a6-ec82-4d82-a0be-70055e0c9544 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:53.341978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09949a6-ec82-4d82-a0be-70055e0c9544 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:53.342163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09949a6-ec82-4d82-a0be-70055e0c9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:53.359220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f09949a6-ec82-4d82-a0be-70055e0c9544 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:53.360387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f09949a6-ec82-4d82-a0be-70055e0c9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:53.423702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 584/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:53.448051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3648c67-dff1-48eb-b176-57389bda58cf None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:53.473637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:53.549638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3648c67-dff1-48eb-b176-57389bda58cf None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:53.584583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e699b7b-a1be-4ad8-935c-f57c323b4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:53.585321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699b7b-a1be-4ad8-935c-f57c323b4328 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:53.585612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699b7b-a1be-4ad8-935c-f57c323b4328 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:53.585895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699b7b-a1be-4ad8-935c-f57c323b4328 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:53.587093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e699b7b-a1be-4ad8-935c-f57c323b4328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:53.588527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e699b7b-a1be-4ad8-935c-f57c323b4328 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:53.590120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 525/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:53.595719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09949a6-ec82-4d82-a0be-70055e0c9544 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:53.614341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:53.691422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09949a6-ec82-4d82-a0be-70055e0c9544 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:53.724299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3af2-ebbb-4ef3-992b-78c485278320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:53.724974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3af2-ebbb-4ef3-992b-78c485278320 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:53.725261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3af2-ebbb-4ef3-992b-78c485278320 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:53.725543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3af2-ebbb-4ef3-992b-78c485278320 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:53.726257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a3af2-ebbb-4ef3-992b-78c485278320 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:53.727707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a3af2-ebbb-4ef3-992b-78c485278320 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:53.747073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 585/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:34:53 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:34:55.771326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26221e-ae29-46f2-b423-c0c4d4dda028 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:55.771795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26221e-ae29-46f2-b423-c0c4d4dda028 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:55.771974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26221e-ae29-46f2-b423-c0c4d4dda028 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:55.773256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 526/1111] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:55.778391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02d85-5ab0-4829-9547-0f0a74e98fb4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:55.778800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02d85-5ab0-4829-9547-0f0a74e98fb4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:55.779052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02d85-5ab0-4829-9547-0f0a74e98fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:55.796537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b3e02d85-5ab0-4829-9547-0f0a74e98fb4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:55.797755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b3e02d85-5ab0-4829-9547-0f0a74e98fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:55.862363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 586/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:55.885604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26221e-ae29-46f2-b423-c0c4d4dda028 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:55.974297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:55.985081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26221e-ae29-46f2-b423-c0c4d4dda028 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:56.017352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:56.018800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:56.019112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:56.019394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] PATH_INFO: `/v3/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:56.020862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] RBAC: Authorizing `identity:get_role(role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:56.022225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:56.023608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 527/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:34:55 2022] GET /identity/v3/roles/c9b4590007f942458d155393f4a0da83 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:56.029213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02d85-5ab0-4829-9547-0f0a74e98fb4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:56.032512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:56.123537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02d85-5ab0-4829-9547-0f0a74e98fb4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:56.155965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:56.157091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:56.157376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:56.157652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] PATH_INFO: `/v3/users/5cfc02b4a709412b83c0598685e0c07e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:56.170893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] RBAC: Authorizing `identity:get_user(user_id=5cfc02b4a709412b83c0598685e0c07e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:56.172363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:56.174018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 587/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:34:56 2022] GET /identity/v3/users/5cfc02b4a709412b83c0598685e0c07e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:56.179741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:56.275331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c8af8-aa65-4c95-9d66-54ab85d5db58 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:56.308312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:56.308957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:56.309246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:56.309525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:56.335567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:56.374869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:56.376324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:56.470775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 528/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:34:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:34:56.477194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:56.537810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:56.575265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245000a-0b69-4c81-8414-376bb295324f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:56.607696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db93039-aa46-4d64-82f0-bfd8aca8e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:56.608562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db93039-aa46-4d64-82f0-bfd8aca8e100 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:56.608851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db93039-aa46-4d64-82f0-bfd8aca8e100 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:56.609131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db93039-aa46-4d64-82f0-bfd8aca8e100 None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:56.610292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db93039-aa46-4d64-82f0-bfd8aca8e100 None admin] RBAC: Authorizing `identity:get_project(project_id=c67cd052f63842c7bcd83a59ff872848)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:56.612314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db93039-aa46-4d64-82f0-bfd8aca8e100 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:56.614003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 588/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:34:56 2022] GET /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:56.620149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:56.676204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:56.716097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1c1a0-123d-46eb-ab73-94398bff1ccb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:56.749624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714812f4-4c03-44d4-b4f2-0aa19ebc59e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:56.750286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714812f4-4c03-44d4-b4f2-0aa19ebc59e9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:56.750577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714812f4-4c03-44d4-b4f2-0aa19ebc59e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:56.750861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714812f4-4c03-44d4-b4f2-0aa19ebc59e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:56.751721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714812f4-4c03-44d4-b4f2-0aa19ebc59e9 None admin] RBAC: Adding query filter params (role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=c67cd052f63842c7bcd83a59ff872848, user.id=5cfc02b4a709412b83c0598685e0c07e) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:34:56.752041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714812f4-4c03-44d4-b4f2-0aa19ebc59e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:56.753455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714812f4-4c03-44d4-b4f2-0aa19ebc59e9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:56.758687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 529/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:34:56 2022] GET /identity/v3/role_assignments?user.id=5cfc02b4a709412b83c0598685e0c07e&scope.project.id=c67cd052f63842c7bcd83a59ff872848&role.id=c9b4590007f942458d155393f4a0da83 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:58.744463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba7f66-9574-4eb8-9f32-c6fec75c74f1 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:58.744954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba7f66-9574-4eb8-9f32-c6fec75c74f1 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:58.745046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba7f66-9574-4eb8-9f32-c6fec75c74f1 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:58.746409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 589/1118] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:34:58.751680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fbea0-ffe7-4329-ba84-20b8c269dc45 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:58.752617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fbea0-ffe7-4329-ba84-20b8c269dc45 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:58.752753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fbea0-ffe7-4329-ba84-20b8c269dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:58.769641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-188fbea0-ffe7-4329-ba84-20b8c269dc45 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:34:58.770809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-188fbea0-ffe7-4329-ba84-20b8c269dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:34:58.835607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 530/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:34:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:34:58.858116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba7f66-9574-4eb8-9f32-c6fec75c74f1 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:58.956756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba7f66-9574-4eb8-9f32-c6fec75c74f1 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:58.983373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:58.989205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:58.990065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:58.990346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:58.990620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] PATH_INFO: `/v3/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:58.992102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] RBAC: Authorizing `identity:get_role(role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:58.993456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:58.994805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 590/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:34:58 2022] GET /identity/v3/roles/c9b4590007f942458d155393f4a0da83 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:59.000960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fbea0-ffe7-4329-ba84-20b8c269dc45 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:59.052559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:59.097556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fbea0-ffe7-4329-ba84-20b8c269dc45 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:59.130252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:59.131267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:59.131552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:59.131826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] PATH_INFO: `/v3/users/5cfc02b4a709412b83c0598685e0c07e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:59.132992 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] RBAC: Authorizing `identity:get_user(user_id=5cfc02b4a709412b83c0598685e0c07e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:59.134405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:59.136031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 531/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:34:58 2022] GET /identity/v3/users/5cfc02b4a709412b83c0598685e0c07e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:59.141887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:59.235649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a95a1e-da72-4ab5-8101-e1dd5ee5ae15 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:59.268188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc33df7-5822-439d-875f-7432141c3a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:59.269041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc33df7-5822-439d-875f-7432141c3a7a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:59.269329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc33df7-5822-439d-875f-7432141c3a7a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:59.269608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc33df7-5822-439d-875f-7432141c3a7a None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:59.270763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc33df7-5822-439d-875f-7432141c3a7a None admin] RBAC: Authorizing `identity:get_project(project_id=c67cd052f63842c7bcd83a59ff872848)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:59.272201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc33df7-5822-439d-875f-7432141c3a7a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:59.273848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 591/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:34:59 2022] GET /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:34:59.279600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:34:59.374908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0259e-1c7a-44e0-a484-088fa41d71aa None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:34:59.394243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:34:59.408656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b32fb1-b215-4ec9-9d8f-5d18b5eedf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:34:59.409546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32fb1-b215-4ec9-9d8f-5d18b5eedf35 None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:34:59.409833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32fb1-b215-4ec9-9d8f-5d18b5eedf35 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:34:59.410113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32fb1-b215-4ec9-9d8f-5d18b5eedf35 None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848/users/5cfc02b4a709412b83c0598685e0c07e/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:34:59.412309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b32fb1-b215-4ec9-9d8f-5d18b5eedf35 None admin] RBAC: Authorizing `identity:create_grant(project_id=c67cd052f63842c7bcd83a59ff872848, user_id=5cfc02b4a709412b83c0598685e0c07e, role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:34:59.413722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b32fb1-b215-4ec9-9d8f-5d18b5eedf35 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:34:59.425830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 532/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:34:59 2022] PUT /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848/users/5cfc02b4a709412b83c0598685e0c07e/roles/c9b4590007f942458d155393f4a0da83 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:35:01.386131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45cf2e-f8d2-4ce6-8df7-13396c9280a1 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:01.386737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45cf2e-f8d2-4ce6-8df7-13396c9280a1 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:01.386737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45cf2e-f8d2-4ce6-8df7-13396c9280a1 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:01.388111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 592/1124] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:01.393608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5aa3-a706-4718-92fc-c3302e994874 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:01.394034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5aa3-a706-4718-92fc-c3302e994874 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:01.394180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5aa3-a706-4718-92fc-c3302e994874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:01.411301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-932a5aa3-a706-4718-92fc-c3302e994874 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:01.412502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-932a5aa3-a706-4718-92fc-c3302e994874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:01.476155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 533/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:01.499706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45cf2e-f8d2-4ce6-8df7-13396c9280a1 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:01.564430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:01.599397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45cf2e-f8d2-4ce6-8df7-13396c9280a1 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:01.631900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:01.632749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:01.633039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:01.633320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] PATH_INFO: `/v3/roles/c9b4590007f942458d155393f4a0da83` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:01.634783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] RBAC: Authorizing `identity:get_role(role_id=c9b4590007f942458d155393f4a0da83)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:01.637653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:01.638976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 593/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:01 2022] GET /identity/v3/roles/c9b4590007f942458d155393f4a0da83 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:01.645059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a5aa3-a706-4718-92fc-c3302e994874 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:01.740101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a5aa3-a706-4718-92fc-c3302e994874 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:01.750993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:01.775127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:01.776013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:01.776300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:01.776578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] PATH_INFO: `/v3/users/5cfc02b4a709412b83c0598685e0c07e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:01.777752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] RBAC: Authorizing `identity:get_user(user_id=5cfc02b4a709412b83c0598685e0c07e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:01.779218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:01.780843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 534/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:01 2022] GET /identity/v3/users/5cfc02b4a709412b83c0598685e0c07e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:01.786870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:01.880943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b130-dc5b-4c49-bc12-e66181c781bb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:01.913287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:01.913870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:01.914155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:01.914434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:01.916967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:01.979647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:01.981106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:02.074807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 594/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:35:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:35:02.080847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:02.177778 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a8930-f640-41db-b0e6-86b6f23cf563 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:02.210217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b54852-270d-49de-8bdb-6066250a835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:02.211105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54852-270d-49de-8bdb-6066250a835c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:02.211395 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54852-270d-49de-8bdb-6066250a835c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:02.211678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54852-270d-49de-8bdb-6066250a835c None admin] PATH_INFO: `/v3/projects/c67cd052f63842c7bcd83a59ff872848` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:02.212844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b54852-270d-49de-8bdb-6066250a835c None admin] RBAC: Authorizing `identity:get_project(project_id=c67cd052f63842c7bcd83a59ff872848)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:02.214284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b54852-270d-49de-8bdb-6066250a835c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:02.215987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 535/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:35:02 2022] GET /identity/v3/projects/c67cd052f63842c7bcd83a59ff872848 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:02.222473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:02.253944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:02.317065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e7441-5c4c-4bb8-b7b8-b0a44bbbc09f None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:02.349198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf5f8a-d1e7-478b-b509-9f822ea3fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:02.349848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5f8a-d1e7-478b-b509-9f822ea3fec4 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:02.350135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5f8a-d1e7-478b-b509-9f822ea3fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:02.350412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5f8a-d1e7-478b-b509-9f822ea3fec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:02.351276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf5f8a-d1e7-478b-b509-9f822ea3fec4 None admin] RBAC: Adding query filter params (role.id=c9b4590007f942458d155393f4a0da83, scope.project.id=c67cd052f63842c7bcd83a59ff872848, user.id=5cfc02b4a709412b83c0598685e0c07e) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:02.351591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf5f8a-d1e7-478b-b509-9f822ea3fec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:02.353013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf5f8a-d1e7-478b-b509-9f822ea3fec4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:02.358719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 595/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:35:02 2022] GET /identity/v3/role_assignments?user.id=5cfc02b4a709412b83c0598685e0c07e&scope.project.id=c67cd052f63842c7bcd83a59ff872848&role.id=c9b4590007f942458d155393f4a0da83 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:04.372845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a50ec-d80a-4af7-bc1a-afd3d1089953 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:04.373390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a50ec-d80a-4af7-bc1a-afd3d1089953 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:04.373490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a50ec-d80a-4af7-bc1a-afd3d1089953 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:04.374786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 536/1131] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:04.380099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8c855-d028-4bc2-a8ad-d65c49456b1d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:04.380490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8c855-d028-4bc2-a8ad-d65c49456b1d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:04.380680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8c855-d028-4bc2-a8ad-d65c49456b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:04.397479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8ef8c855-d028-4bc2-a8ad-d65c49456b1d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:04.398665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8ef8c855-d028-4bc2-a8ad-d65c49456b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:04.465496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 596/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:04.489483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a50ec-d80a-4af7-bc1a-afd3d1089953 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:04.536017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:04.588665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a50ec-d80a-4af7-bc1a-afd3d1089953 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:04.620952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eabeb-9c49-4145-b100-193dbe4a4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:04.621737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eabeb-9c49-4145-b100-193dbe4a4b2a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:04.622021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eabeb-9c49-4145-b100-193dbe4a4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:04.622301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eabeb-9c49-4145-b100-193dbe4a4b2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:04.623520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eabeb-9c49-4145-b100-193dbe4a4b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:04.624891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eabeb-9c49-4145-b100-193dbe4a4b2a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:04.626458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 537/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:35:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:04.632127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8c855-d028-4bc2-a8ad-d65c49456b1d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:04.660047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:04.732848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8c855-d028-4bc2-a8ad-d65c49456b1d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:04.765750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb83b82-7d22-4da0-9a26-c44e165efa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:04.766417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83b82-7d22-4da0-9a26-c44e165efa3e None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:04.766711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83b82-7d22-4da0-9a26-c44e165efa3e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:04.767024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83b82-7d22-4da0-9a26-c44e165efa3e None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:04.768396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb83b82-7d22-4da0-9a26-c44e165efa3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:04.769836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb83b82-7d22-4da0-9a26-c44e165efa3e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:04.794762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 597/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:35:04 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:35:06.825109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01b79-98ba-43ce-aabe-0867ef579130 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:06.825613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01b79-98ba-43ce-aabe-0867ef579130 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:06.825703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01b79-98ba-43ce-aabe-0867ef579130 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:06.827064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 538/1135] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:06.832711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb85b5-35bb-4c87-becf-119a74e7a144 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:06.833131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb85b5-35bb-4c87-becf-119a74e7a144 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:06.833293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb85b5-35bb-4c87-becf-119a74e7a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:06.850893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-abcb85b5-35bb-4c87-becf-119a74e7a144 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:06.852170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-abcb85b5-35bb-4c87-becf-119a74e7a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:06.916825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 598/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:06.941622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01b79-98ba-43ce-aabe-0867ef579130 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:07.039865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01b79-98ba-43ce-aabe-0867ef579130 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:07.053150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:07.073113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0368-1db5-4827-9582-b78b67a2a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:07.073900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0368-1db5-4827-9582-b78b67a2a864 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:07.074190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0368-1db5-4827-9582-b78b67a2a864 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:07.074465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0368-1db5-4827-9582-b78b67a2a864 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:07.075636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0368-1db5-4827-9582-b78b67a2a864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:07.077052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0368-1db5-4827-9582-b78b67a2a864 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:07.078642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 539/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:07.084953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb85b5-35bb-4c87-becf-119a74e7a144 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:07.096283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:07.179763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb85b5-35bb-4c87-becf-119a74e7a144 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:07.212334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3e327-4532-4c2b-9fbe-cc1b142622a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:07.212996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e327-4532-4c2b-9fbe-cc1b142622a5 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:07.213281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e327-4532-4c2b-9fbe-cc1b142622a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:07.213559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e327-4532-4c2b-9fbe-cc1b142622a5 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:07.214268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3e327-4532-4c2b-9fbe-cc1b142622a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:07.215713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3e327-4532-4c2b-9fbe-cc1b142622a5 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:07.234303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 599/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:35:07 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:35:09.261486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de6cf2-707b-4151-a8fd-96344d47da30 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:09.262028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de6cf2-707b-4151-a8fd-96344d47da30 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:09.262028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de6cf2-707b-4151-a8fd-96344d47da30 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:09.263462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 540/1139] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:09.269216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba87b3-efd4-4e09-aebb-e8346df8c21e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:09.269612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba87b3-efd4-4e09-aebb-e8346df8c21e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:09.269777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba87b3-efd4-4e09-aebb-e8346df8c21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:09.286447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0fba87b3-efd4-4e09-aebb-e8346df8c21e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:09.287645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0fba87b3-efd4-4e09-aebb-e8346df8c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:09.344288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:09.352300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 600/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:09.375101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de6cf2-707b-4151-a8fd-96344d47da30 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:09.473296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de6cf2-707b-4151-a8fd-96344d47da30 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:09.505579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:09.506372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:09.506660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:09.506967 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:09.516675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:35:09.524255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:35:09.525394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:35:09.526317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 541/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:35:09.531111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba87b3-efd4-4e09-aebb-e8346df8c21e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:09.625955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba87b3-efd4-4e09-aebb-e8346df8c21e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:09.659086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:09.659747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:09.660034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:09.660309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:09.661050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:09.661356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:09.662717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:09.670401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 601/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:09.675904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:09.718176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:09.772995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d83d8e-ce70-43cf-b50b-05e89ece2eac None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:09.805311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:09.806180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:09.806468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:09.806748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] PATH_INFO: `/v3/users/4c0e1d38dc694ae5bbd0368ea1059164` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:09.819429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] RBAC: Authorizing `identity:get_user(user_id=4c0e1d38dc694ae5bbd0368ea1059164)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:09.820861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:09.822488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 542/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:09 2022] GET /identity/v3/users/4c0e1d38dc694ae5bbd0368ea1059164 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:09.828342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:09.884515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:09.925501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b61393-08ae-4fe7-8b73-4856bec7a168 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:09.957304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:09.957942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:09.958229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:09.958511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:10.021354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:10.022786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:10.076202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:10.116869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 602/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:35:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:35:10.122804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:10.216043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:10.218780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c73354-e4f8-4b8f-8f33-ed90d753bf2a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:10.251020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d3c7b-72c8-41c8-8b52-29dce7d82a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:10.252381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3c7b-72c8-41c8-8b52-29dce7d82a8c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:10.252670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3c7b-72c8-41c8-8b52-29dce7d82a8c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:10.252953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3c7b-72c8-41c8-8b52-29dce7d82a8c None admin] PATH_INFO: `/v3/projects/796d16b8aa68495e8077e84dbbd15660` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:10.254117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d3c7b-72c8-41c8-8b52-29dce7d82a8c None admin] RBAC: Authorizing `identity:get_project(project_id=796d16b8aa68495e8077e84dbbd15660)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:10.255566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d3c7b-72c8-41c8-8b52-29dce7d82a8c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:10.257236 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 543/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:35:10 2022] GET /identity/v3/projects/796d16b8aa68495e8077e84dbbd15660 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:10.263090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:10.356747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f03df-e609-4e97-83b0-1e5e3ed8dc75 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:10.388837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506b141-9b14-4699-b0fc-2246a38cf5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:10.389477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b141-9b14-4699-b0fc-2246a38cf5d8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:10.389761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b141-9b14-4699-b0fc-2246a38cf5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:10.390037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b141-9b14-4699-b0fc-2246a38cf5d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:10.390855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506b141-9b14-4699-b0fc-2246a38cf5d8 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=796d16b8aa68495e8077e84dbbd15660, user.id=4c0e1d38dc694ae5bbd0368ea1059164) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:10.391191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506b141-9b14-4699-b0fc-2246a38cf5d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:10.393118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506b141-9b14-4699-b0fc-2246a38cf5d8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:10.398326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 603/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:35:10 2022] GET /identity/v3/role_assignments?user.id=4c0e1d38dc694ae5bbd0368ea1059164&scope.project.id=796d16b8aa68495e8077e84dbbd15660&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:12.365750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5fdb1-a924-45b0-ab9c-a3bf1df69ba1 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:12.366312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5fdb1-a924-45b0-ab9c-a3bf1df69ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:12.366312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5fdb1-a924-45b0-ab9c-a3bf1df69ba1 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:12.367716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 544/1147] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:12.373032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42a04-565c-4f59-8bbb-25887453574d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:12.373457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42a04-565c-4f59-8bbb-25887453574d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:12.373603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b42a04-565c-4f59-8bbb-25887453574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:12.390355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-00b42a04-565c-4f59-8bbb-25887453574d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:12.391637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-00b42a04-565c-4f59-8bbb-25887453574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:12.408325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:12.457089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 604/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:12.479037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5fdb1-a924-45b0-ab9c-a3bf1df69ba1 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:12.575813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5fdb1-a924-45b0-ab9c-a3bf1df69ba1 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:12.607801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:12.608583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:12.608867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:12.609145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:12.619273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:35:12.627323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:35:12.628423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:35:12.629425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 545/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:35:12.634252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42a04-565c-4f59-8bbb-25887453574d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:12.729514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b42a04-565c-4f59-8bbb-25887453574d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:12.762730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:12.763428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:12.763721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:12.764004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:12.764752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:12.765064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:12.766434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:12.774231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 605/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:12.779891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:12.807650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:12.876586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77c0a6-8442-4431-a2ef-0ae19970e2e5 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:12.908707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:12.909569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:12.909858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:12.910142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] PATH_INFO: `/v3/users/4c0e1d38dc694ae5bbd0368ea1059164` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:12.911338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] RBAC: Authorizing `identity:get_user(user_id=4c0e1d38dc694ae5bbd0368ea1059164)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:12.912760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:12.914351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 546/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:12 2022] GET /identity/v3/users/4c0e1d38dc694ae5bbd0368ea1059164 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:12.919847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:12.935837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:13.017939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b23b4c-4a1f-4d9f-9b63-aae63d82b59b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:13.050936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94a2b2-7faf-432f-ac33-80442784521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:13.051819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94a2b2-7faf-432f-ac33-80442784521c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:13.052104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94a2b2-7faf-432f-ac33-80442784521c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:13.052381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94a2b2-7faf-432f-ac33-80442784521c None admin] PATH_INFO: `/v3/projects/796d16b8aa68495e8077e84dbbd15660` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:13.053548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94a2b2-7faf-432f-ac33-80442784521c None admin] RBAC: Authorizing `identity:get_project(project_id=796d16b8aa68495e8077e84dbbd15660)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:13.054999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94a2b2-7faf-432f-ac33-80442784521c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:13.056689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 606/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:35:12 2022] GET /identity/v3/projects/796d16b8aa68495e8077e84dbbd15660 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:13.062503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:13.153111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:13.159865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a4950-2365-4de4-a574-dd6a2da5fd74 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:13.191776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466c748-91c3-4959-a27d-e95cde0f7bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:13.192670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466c748-91c3-4959-a27d-e95cde0f7bcd None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:13.192962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466c748-91c3-4959-a27d-e95cde0f7bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:13.193250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466c748-91c3-4959-a27d-e95cde0f7bcd None admin] PATH_INFO: `/v3/projects/796d16b8aa68495e8077e84dbbd15660/users/4c0e1d38dc694ae5bbd0368ea1059164/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:13.195225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466c748-91c3-4959-a27d-e95cde0f7bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=796d16b8aa68495e8077e84dbbd15660, user_id=4c0e1d38dc694ae5bbd0368ea1059164, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:13.196653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466c748-91c3-4959-a27d-e95cde0f7bcd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:13.209726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 547/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:35:13 2022] PUT /identity/v3/projects/796d16b8aa68495e8077e84dbbd15660/users/4c0e1d38dc694ae5bbd0368ea1059164/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:35:15.213483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053216d-9c89-41dc-b94d-c4093289d9a9 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:15.214064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053216d-9c89-41dc-b94d-c4093289d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:15.214064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053216d-9c89-41dc-b94d-c4093289d9a9 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:15.215466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 607/1154] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:15.221315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd6235-0c29-4254-a042-e59b2b8e2e69 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:15.221721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd6235-0c29-4254-a042-e59b2b8e2e69 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:15.221879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd6235-0c29-4254-a042-e59b2b8e2e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:15.238359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-dbcd6235-0c29-4254-a042-e59b2b8e2e69 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:15.239567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dbcd6235-0c29-4254-a042-e59b2b8e2e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:15.303600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 548/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:15.327199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053216d-9c89-41dc-b94d-c4093289d9a9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:15.407964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:15.426929 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053216d-9c89-41dc-b94d-c4093289d9a9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:15.461248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:15.462040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:15.462331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:15.462616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:15.472591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:35:15.480255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:35:15.481353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:35:15.482407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 608/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:35:15.487347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd6235-0c29-4254-a042-e59b2b8e2e69 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:15.568430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:15.583702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd6235-0c29-4254-a042-e59b2b8e2e69 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:15.616018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:15.616677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:15.616965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:15.617246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:15.617991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:15.618300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:15.619683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:15.627546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 549/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:35:15.633055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:15.740715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2c492-8560-49d5-9ce0-56fcd456b2ba None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:15.782623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:15.784110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:15.784394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:15.784669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] PATH_INFO: `/v3/users/4c0e1d38dc694ae5bbd0368ea1059164` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:15.785847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] RBAC: Authorizing `identity:get_user(user_id=4c0e1d38dc694ae5bbd0368ea1059164)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:15.787294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:15.788917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 609/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:15 2022] GET /identity/v3/users/4c0e1d38dc694ae5bbd0368ea1059164 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:15.794769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:15.893422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04accefd-d821-4949-976e-d15f9be7e8e6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:15.925712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:15.926364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:15.926653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:15.926958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:15.944136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:15.991861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:15.993238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:16.086857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 550/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:35:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:35:16.092682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:16.105537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:16.190405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b1ed2-dd99-4969-973e-6358658ed75a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:16.222539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7d021-dd77-4b3e-b5fa-2ed71f5ae098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:16.223425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d021-dd77-4b3e-b5fa-2ed71f5ae098 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:16.223707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d021-dd77-4b3e-b5fa-2ed71f5ae098 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:16.223983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d021-dd77-4b3e-b5fa-2ed71f5ae098 None admin] PATH_INFO: `/v3/projects/796d16b8aa68495e8077e84dbbd15660` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:16.225139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7d021-dd77-4b3e-b5fa-2ed71f5ae098 None admin] RBAC: Authorizing `identity:get_project(project_id=796d16b8aa68495e8077e84dbbd15660)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:16.226557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7d021-dd77-4b3e-b5fa-2ed71f5ae098 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:16.228238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 610/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:35:16 2022] GET /identity/v3/projects/796d16b8aa68495e8077e84dbbd15660 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:16.234137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:16.281431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:16.330103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51229d6-6b76-4ef2-8f1d-f86e07500197 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:16.362633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba658c-6356-4d8c-89c7-e820b7cd0169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:16.363310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba658c-6356-4d8c-89c7-e820b7cd0169 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:16.363599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba658c-6356-4d8c-89c7-e820b7cd0169 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:16.363881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba658c-6356-4d8c-89c7-e820b7cd0169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:16.364708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba658c-6356-4d8c-89c7-e820b7cd0169 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=796d16b8aa68495e8077e84dbbd15660, user.id=4c0e1d38dc694ae5bbd0368ea1059164) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:16.365023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba658c-6356-4d8c-89c7-e820b7cd0169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:16.366440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba658c-6356-4d8c-89c7-e820b7cd0169 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:16.372088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 551/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:35:16 2022] GET /identity/v3/role_assignments?user.id=4c0e1d38dc694ae5bbd0368ea1059164&scope.project.id=796d16b8aa68495e8077e84dbbd15660&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:18.466685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34b8f6-dc03-4636-9bb5-9c65de6daba2 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:18.467264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34b8f6-dc03-4636-9bb5-9c65de6daba2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:18.467264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34b8f6-dc03-4636-9bb5-9c65de6daba2 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:18.468671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 611/1162] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:18.473910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ceb2-bf42-4555-a8fd-71e78f70e195 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:18.474310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ceb2-bf42-4555-a8fd-71e78f70e195 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:18.474477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ceb2-bf42-4555-a8fd-71e78f70e195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:18.490719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ad41ceb2-bf42-4555-a8fd-71e78f70e195 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:18.491923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ad41ceb2-bf42-4555-a8fd-71e78f70e195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:18.555304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 552/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:35:18.577764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34b8f6-dc03-4636-9bb5-9c65de6daba2 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:18.654437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:18.676942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34b8f6-dc03-4636-9bb5-9c65de6daba2 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:18.709589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:18.710245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:18.710538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:18.710821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:18.775375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:18.776819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:18.849273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:18.870660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 612/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:35:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:35:18.877294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41ceb2-bf42-4555-a8fd-71e78f70e195 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:18.917867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:18.972240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41ceb2-bf42-4555-a8fd-71e78f70e195 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:19.004835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb4a2-8b04-4f0e-b7b1-f05bbba923a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:19.005636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb4a2-8b04-4f0e-b7b1-f05bbba923a7 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:19.005921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb4a2-8b04-4f0e-b7b1-f05bbba923a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:19.006202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb4a2-8b04-4f0e-b7b1-f05bbba923a7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:19.012583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb4a2-8b04-4f0e-b7b1-f05bbba923a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:19.014002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb4a2-8b04-4f0e-b7b1-f05bbba923a7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-a15eb4a2-8b04-4f0e-b7b1-f05bbba923a7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:35:19.027747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:35:19.028952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:35:19.030006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 553/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:35:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:35:19.035847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:19.130519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9ec11-e6f0-4fe5-a70f-098fdb916a4d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:19.163788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c87020-54b0-4911-b097-67576e964603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:19.164449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87020-54b0-4911-b097-67576e964603 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:19.164744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87020-54b0-4911-b097-67576e964603 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:19.165031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87020-54b0-4911-b097-67576e964603 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:19.165761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87020-54b0-4911-b097-67576e964603 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:19.166073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87020-54b0-4911-b097-67576e964603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:19.167483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87020-54b0-4911-b097-67576e964603 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:19.175076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 613/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Jun 20 18:35:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:21.168271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ee7ff-a46f-4770-b2e6-962ce971d4b6 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:21.168863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ee7ff-a46f-4770-b2e6-962ce971d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:21.168863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ee7ff-a46f-4770-b2e6-962ce971d4b6 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:21.170278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 554/1167] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:21.175474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c351f-0e51-42e1-ab60-d92d97b26e83 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:21.175914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c351f-0e51-42e1-ab60-d92d97b26e83 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:21.176038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c351f-0e51-42e1-ab60-d92d97b26e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:21.192257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2f3c351f-0e51-42e1-ab60-d92d97b26e83 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:21.193418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2f3c351f-0e51-42e1-ab60-d92d97b26e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:21.227779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:21.259111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 614/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:21.282474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ee7ff-a46f-4770-b2e6-962ce971d4b6 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:21.380186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ee7ff-a46f-4770-b2e6-962ce971d4b6 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:21.381655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:21.414283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea521-e244-40e4-b1bd-657942fc4f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:21.414961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea521-e244-40e4-b1bd-657942fc4f78 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:21.415256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea521-e244-40e4-b1bd-657942fc4f78 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:21.415542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea521-e244-40e4-b1bd-657942fc4f78 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:21.416277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea521-e244-40e4-b1bd-657942fc4f78 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:21.417636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea521-e244-40e4-b1bd-657942fc4f78 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:21.431441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 555/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Mon Jun 20 18:35:21 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:35:23.450006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64564d-e29c-4d1b-8b47-416380fdb911 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:23.450539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64564d-e29c-4d1b-8b47-416380fdb911 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:23.450539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64564d-e29c-4d1b-8b47-416380fdb911 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:23.451974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 615/1170] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:23.457523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6629-bb7f-4ba2-b1f9-02ea5e452a0a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:23.457920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6629-bb7f-4ba2-b1f9-02ea5e452a0a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:23.458092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6629-bb7f-4ba2-b1f9-02ea5e452a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:23.474949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-861b6629-bb7f-4ba2-b1f9-02ea5e452a0a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:23.476099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-861b6629-bb7f-4ba2-b1f9-02ea5e452a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:23.538636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 556/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:23.561661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64564d-e29c-4d1b-8b47-416380fdb911 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:23.658991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64564d-e29c-4d1b-8b47-416380fdb911 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:23.690983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf4754-6ce8-41ac-84b5-cb5db3e26a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:23.691836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf4754-6ce8-41ac-84b5-cb5db3e26a87 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:23.692120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf4754-6ce8-41ac-84b5-cb5db3e26a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:23.692398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf4754-6ce8-41ac-84b5-cb5db3e26a87 None admin] PATH_INFO: `/v3/domains/e285d05b4aa440aeaffe989999ac065a` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:23.702466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf4754-6ce8-41ac-84b5-cb5db3e26a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e285d05b4aa440aeaffe989999ac065a)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:23.703876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf4754-6ce8-41ac-84b5-cb5db3e26a87 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:23.706136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 616/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Mon Jun 20 18:35:23 2022] GET /identity/v3/domains/e285d05b4aa440aeaffe989999ac065a => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:23.711862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6629-bb7f-4ba2-b1f9-02ea5e452a0a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:23.798119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:23.807706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6629-bb7f-4ba2-b1f9-02ea5e452a0a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:23.842616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543f756-957c-4be6-8e03-4c0e910483e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:23.843408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f756-957c-4be6-8e03-4c0e910483e7 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:23.843700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f756-957c-4be6-8e03-4c0e910483e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:23.843983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f756-957c-4be6-8e03-4c0e910483e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:23.844687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543f756-957c-4be6-8e03-4c0e910483e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:23.846112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543f756-957c-4be6-8e03-4c0e910483e7 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:23.869810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 557/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:35:23 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:35:25.895352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80c3a7-fb1d-405c-b27e-88eaa4a4070c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:25.895883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80c3a7-fb1d-405c-b27e-88eaa4a4070c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:25.895982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80c3a7-fb1d-405c-b27e-88eaa4a4070c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:25.897313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 617/1174] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:25.902495 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76495d4-9ed0-4acb-9bc4-58e589908ed9 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:25.902947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76495d4-9ed0-4acb-9bc4-58e589908ed9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:25.903108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76495d4-9ed0-4acb-9bc4-58e589908ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:25.920918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b76495d4-9ed0-4acb-9bc4-58e589908ed9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:25.922093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b76495d4-9ed0-4acb-9bc4-58e589908ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:25.986989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 558/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:26.011332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80c3a7-fb1d-405c-b27e-88eaa4a4070c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:26.042344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:26.111448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80c3a7-fb1d-405c-b27e-88eaa4a4070c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:26.143993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed82fa-b38b-4c64-8ec3-fc7a3b8ed2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:26.144851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed82fa-b38b-4c64-8ec3-fc7a3b8ed2a9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:26.145141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed82fa-b38b-4c64-8ec3-fc7a3b8ed2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:26.145421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed82fa-b38b-4c64-8ec3-fc7a3b8ed2a9 None admin] PATH_INFO: `/v3/domains/e285d05b4aa440aeaffe989999ac065a` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:26.146595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed82fa-b38b-4c64-8ec3-fc7a3b8ed2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e285d05b4aa440aeaffe989999ac065a)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:26.148058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed82fa-b38b-4c64-8ec3-fc7a3b8ed2a9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:26.149648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 618/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Mon Jun 20 18:35:26 2022] GET /identity/v3/domains/e285d05b4aa440aeaffe989999ac065a => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:26.155159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76495d4-9ed0-4acb-9bc4-58e589908ed9 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:26.226744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:26.251562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76495d4-9ed0-4acb-9bc4-58e589908ed9 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:26.284360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbddf0-2aa0-4cde-9b4a-67febdac3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:26.285024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbddf0-2aa0-4cde-9b4a-67febdac3fdc None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:26.285316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbddf0-2aa0-4cde-9b4a-67febdac3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:26.285600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbddf0-2aa0-4cde-9b4a-67febdac3fdc None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:26.286320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbddf0-2aa0-4cde-9b4a-67febdac3fdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:26.287776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbddf0-2aa0-4cde-9b4a-67febdac3fdc None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:26.306604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 559/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:35:26 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:35:28.377995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d86d-aa91-4313-b09e-9f14d4f3f94b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:28.378528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d86d-aa91-4313-b09e-9f14d4f3f94b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:28.378528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d86d-aa91-4313-b09e-9f14d4f3f94b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:28.379966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 619/1178] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:28.385124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac250-25f1-4452-8d0f-956f0a571952 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:28.385546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac250-25f1-4452-8d0f-956f0a571952 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:28.385701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dac250-25f1-4452-8d0f-956f0a571952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:28.402033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-08dac250-25f1-4452-8d0f-956f0a571952 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:28.403254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-08dac250-25f1-4452-8d0f-956f0a571952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:28.469397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 560/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:28.493797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d86d-aa91-4313-b09e-9f14d4f3f94b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:28.593199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:28.597799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d86d-aa91-4313-b09e-9f14d4f3f94b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:28.630595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:28.631344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:28.631634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:28.631915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:28.642806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:35:28.650572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:35:28.651940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:35:28.653271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 620/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:35:28.659232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac250-25f1-4452-8d0f-956f0a571952 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:28.715335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:28.755746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dac250-25f1-4452-8d0f-956f0a571952 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:28.788860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:28.789529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:28.789826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:28.790106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:28.790849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:28.791192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:28.792556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:28.800441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 561/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:28.806283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:28.905761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a42e42-0696-4f18-8118-b68aea0b20da None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:28.937721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:28.938588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:28.939423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:28.939705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] PATH_INFO: `/v3/users/8c03f50e9f584c02ae4129f8278051c9` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:28.952316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] RBAC: Authorizing `identity:get_user(user_id=8c03f50e9f584c02ae4129f8278051c9)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:28.953757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:28.956018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 621/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:28 2022] GET /identity/v3/users/8c03f50e9f584c02ae4129f8278051c9 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:28.961810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:29.057750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea775b34-269f-46df-b926-3b9547f04245 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:29.080123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:29.091679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:29.092500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:29.092787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:29.093066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:29.157933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:29.159323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:29.254402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 562/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:35:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:35:29.260457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:29.279011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:29.357638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ed928-fd4a-4880-8e03-9b8059c0f169 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:29.391795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ffc06-b42a-46cc-a309-748eb42773ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:29.392665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ffc06-b42a-46cc-a309-748eb42773ea None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:29.392955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ffc06-b42a-46cc-a309-748eb42773ea None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:29.393237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ffc06-b42a-46cc-a309-748eb42773ea None admin] PATH_INFO: `/v3/projects/08ca490474e04353973e628df8fd07a7` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:29.394417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ffc06-b42a-46cc-a309-748eb42773ea None admin] RBAC: Authorizing `identity:get_project(project_id=08ca490474e04353973e628df8fd07a7)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:29.395942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ffc06-b42a-46cc-a309-748eb42773ea None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:29.397628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 622/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:35:29 2022] GET /identity/v3/projects/08ca490474e04353973e628df8fd07a7 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:29.403626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:29.427058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:29.498544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6a6d-e416-4688-a248-2315310db522 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:29.530104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6484077-8cfe-4e6c-b2ec-01b88a84b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:29.530743 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484077-8cfe-4e6c-b2ec-01b88a84b03b None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:29.531056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484077-8cfe-4e6c-b2ec-01b88a84b03b None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:29.531335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484077-8cfe-4e6c-b2ec-01b88a84b03b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:29.532924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6484077-8cfe-4e6c-b2ec-01b88a84b03b None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=08ca490474e04353973e628df8fd07a7, user.id=8c03f50e9f584c02ae4129f8278051c9) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:29.533244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6484077-8cfe-4e6c-b2ec-01b88a84b03b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:29.534650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6484077-8cfe-4e6c-b2ec-01b88a84b03b None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:29.539850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 563/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:35:29 2022] GET /identity/v3/role_assignments?user.id=8c03f50e9f584c02ae4129f8278051c9&scope.project.id=08ca490474e04353973e628df8fd07a7&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:31.515483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3e12-dd6d-4736-9dad-6957aec8df9b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:31.516013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3e12-dd6d-4736-9dad-6957aec8df9b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:31.516105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3e12-dd6d-4736-9dad-6957aec8df9b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:31.517901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 623/1186] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:31.523051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f75ea-8441-48f1-ba75-68f1d825c723 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:31.523441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f75ea-8441-48f1-ba75-68f1d825c723 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:31.523626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f75ea-8441-48f1-ba75-68f1d825c723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:31.540713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-622f75ea-8441-48f1-ba75-68f1d825c723 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:31.541885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-622f75ea-8441-48f1-ba75-68f1d825c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:31.605820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 564/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:31.627773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3e12-dd6d-4736-9dad-6957aec8df9b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:31.711173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:31.727568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3e12-dd6d-4736-9dad-6957aec8df9b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:31.760332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:31.761125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:31.761414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:31.761695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:31.772058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:35:31.779722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:35:31.780808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:35:31.782328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 624/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:35:31.787350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f75ea-8441-48f1-ba75-68f1d825c723 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:31.804235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:31.883926 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f75ea-8441-48f1-ba75-68f1d825c723 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:31.916736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:31.917404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:31.917693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:31.917978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:31.918727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:31.919077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:31.920446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:31.928271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 565/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:31.933988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:32.030122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031810-a321-4061-b074-cc2e41258e7b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:32.061826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:32.062690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:32.063003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:32.063283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] PATH_INFO: `/v3/users/8c03f50e9f584c02ae4129f8278051c9` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:32.064988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] RBAC: Authorizing `identity:get_user(user_id=8c03f50e9f584c02ae4129f8278051c9)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:32.066425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:32.068042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 625/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:31 2022] GET /identity/v3/users/8c03f50e9f584c02ae4129f8278051c9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:32.073573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:32.149025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:32.170367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43aad2-51a8-4f71-af46-0262f29f61bc None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:32.203269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5698-dbe9-46a3-a744-1748682f5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:32.204134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5698-dbe9-46a3-a744-1748682f5b7d None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:32.204933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5698-dbe9-46a3-a744-1748682f5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:32.205211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5698-dbe9-46a3-a744-1748682f5b7d None admin] PATH_INFO: `/v3/projects/08ca490474e04353973e628df8fd07a7` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:32.206384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5698-dbe9-46a3-a744-1748682f5b7d None admin] RBAC: Authorizing `identity:get_project(project_id=08ca490474e04353973e628df8fd07a7)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:32.207828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5698-dbe9-46a3-a744-1748682f5b7d None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:32.209496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 566/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:35:32 2022] GET /identity/v3/projects/08ca490474e04353973e628df8fd07a7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:32.215168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:32.231319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:32.311632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d11aa-4b30-4623-b433-55e7854b6579 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:32.343677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12668b3-d96d-4bac-b010-6af5dbe72c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:32.344551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12668b3-d96d-4bac-b010-6af5dbe72c91 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:32.344850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12668b3-d96d-4bac-b010-6af5dbe72c91 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:32.345155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12668b3-d96d-4bac-b010-6af5dbe72c91 None admin] PATH_INFO: `/v3/projects/08ca490474e04353973e628df8fd07a7/users/8c03f50e9f584c02ae4129f8278051c9/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:32.347093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12668b3-d96d-4bac-b010-6af5dbe72c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=08ca490474e04353973e628df8fd07a7, user_id=8c03f50e9f584c02ae4129f8278051c9, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:32.348507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12668b3-d96d-4bac-b010-6af5dbe72c91 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:32.361056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 626/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:35:32 2022] PUT /identity/v3/projects/08ca490474e04353973e628df8fd07a7/users/8c03f50e9f584c02ae4129f8278051c9/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:35:34.347099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039431-88cf-4f88-b7f3-77ad345d6e07 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:34.347644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039431-88cf-4f88-b7f3-77ad345d6e07 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:34.347644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039431-88cf-4f88-b7f3-77ad345d6e07 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:34.349018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 567/1193] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:35:34.354159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5dde-7cde-4c38-8491-1ca5aae3951b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:34.354581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5dde-7cde-4c38-8491-1ca5aae3951b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:34.354727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5dde-7cde-4c38-8491-1ca5aae3951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:34.371750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-460a5dde-7cde-4c38-8491-1ca5aae3951b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:35:34.372928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-460a5dde-7cde-4c38-8491-1ca5aae3951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:35:34.436947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 627/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:35:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:35:34.460450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9039431-88cf-4f88-b7f3-77ad345d6e07 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:34.557163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9039431-88cf-4f88-b7f3-77ad345d6e07 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:34.588782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:34.589563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:34.589848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:34.590128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:34.600854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:35:34.608317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:35:34.609436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:35:34.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 568/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:35:34.615152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5dde-7cde-4c38-8491-1ca5aae3951b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:34.618173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:34.713283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5dde-7cde-4c38-8491-1ca5aae3951b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:34.746010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:34.746681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:34.746998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:34.747284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:34.748037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:34.748348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:34.749711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:34.757982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 628/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:34.763669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:34.772807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:34.860851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332f2f-c1b0-4a46-bfd7-e5dd92f8f69c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:34.893596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:34.894459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:34.894746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:34.895054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] PATH_INFO: `/v3/users/8c03f50e9f584c02ae4129f8278051c9` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:34.896228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] RBAC: Authorizing `identity:get_user(user_id=8c03f50e9f584c02ae4129f8278051c9)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:34.897651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:34.899278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 569/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Jun 20 18:35:34 2022] GET /identity/v3/users/8c03f50e9f584c02ae4129f8278051c9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:34.904843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:34.968427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:35.003413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ed2f-5885-4ede-8dc5-725b52a648ff None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:35.035570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:35.036209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:35.036503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:35.036786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:35.100607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:35.102041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:35.162903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:35.198653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 629/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:35:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:35:35.204518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:35.275910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:35.300515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2f077-06a1-43aa-95a2-5c184702bab9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:35.333122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1968e5-5ff6-4a95-8a31-f1bc761b08a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:35.333975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1968e5-5ff6-4a95-8a31-f1bc761b08a4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:35.334265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1968e5-5ff6-4a95-8a31-f1bc761b08a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:35.334550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1968e5-5ff6-4a95-8a31-f1bc761b08a4 None admin] PATH_INFO: `/v3/projects/08ca490474e04353973e628df8fd07a7` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:35.335754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1968e5-5ff6-4a95-8a31-f1bc761b08a4 None admin] RBAC: Authorizing `identity:get_project(project_id=08ca490474e04353973e628df8fd07a7)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:35.337182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1968e5-5ff6-4a95-8a31-f1bc761b08a4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:35.338847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 570/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Jun 20 18:35:35 2022] GET /identity/v3/projects/08ca490474e04353973e628df8fd07a7 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:35:35.344725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:35:35.439990 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e632cd3-69a2-4c9d-80b9-cfd311c76b9e None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:35:35.472581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b996-76ac-4a93-b1b3-f73a006606a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:35:35.473230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b996-76ac-4a93-b1b3-f73a006606a7 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:35:35.473519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b996-76ac-4a93-b1b3-f73a006606a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:35:35.473801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b996-76ac-4a93-b1b3-f73a006606a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:35:35.474632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b996-76ac-4a93-b1b3-f73a006606a7 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=08ca490474e04353973e628df8fd07a7, user.id=8c03f50e9f584c02ae4129f8278051c9) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:35:35.474971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b996-76ac-4a93-b1b3-f73a006606a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:35:35.476402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b996-76ac-4a93-b1b3-f73a006606a7 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:35:35.482024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 630/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:35:35 2022] GET /identity/v3/role_assignments?user.id=8c03f50e9f584c02ae4129f8278051c9&scope.project.id=08ca490474e04353973e628df8fd07a7&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:35:45.329478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=29 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:35:45.479488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=85 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:30.398734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288962c2-e632-400d-9db6-19af87ac713a None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:30.399491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288962c2-e632-400d-9db6-19af87ac713a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:30.399491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288962c2-e632-400d-9db6-19af87ac713a None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:30.401107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 571/1201] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:30.409901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a600aa-1cd4-47f9-835b-de9079108dfe None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:30.409901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a600aa-1cd4-47f9-835b-de9079108dfe None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:30.409901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a600aa-1cd4-47f9-835b-de9079108dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:30.429692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-10a600aa-1cd4-47f9-835b-de9079108dfe None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:30.431094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-10a600aa-1cd4-47f9-835b-de9079108dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:30.524218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 631/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:36:30.555900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288962c2-e632-400d-9db6-19af87ac713a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:30.714283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288962c2-e632-400d-9db6-19af87ac713a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:30.762135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:30.763504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:30.764104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:30.764746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:30.778598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:30.780479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:30.804680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:30.805833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:30.807003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:30.807003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:30.807003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:30.807003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:30.809297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 572/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:36:30.817025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a600aa-1cd4-47f9-835b-de9079108dfe None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:30.964610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a600aa-1cd4-47f9-835b-de9079108dfe None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:31.005013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:31.012856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57630b9f-4eda-4a10-a1cd-56aed4017ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:31.013634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630b9f-4eda-4a10-a1cd-56aed4017ce9 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:31.013923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630b9f-4eda-4a10-a1cd-56aed4017ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:31.014199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630b9f-4eda-4a10-a1cd-56aed4017ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:31.015018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57630b9f-4eda-4a10-a1cd-56aed4017ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:31.015342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57630b9f-4eda-4a10-a1cd-56aed4017ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:31.017940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57630b9f-4eda-4a10-a1cd-56aed4017ce9 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:31.032577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 632/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:31.039211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:31.110150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:31.167686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6e5d-a4d1-4a23-a7e7-18bc3750ecf9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:31.212206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f2acb-e32a-43c1-b471-b697cb6f4a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:31.213216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2acb-e32a-43c1-b471-b697cb6f4a74 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:31.213516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2acb-e32a-43c1-b471-b697cb6f4a74 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:31.213797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2acb-e32a-43c1-b471-b697cb6f4a74 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:31.214825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f2acb-e32a-43c1-b471-b697cb6f4a74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:31.216515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f2acb-e32a-43c1-b471-b697cb6f4a74 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:31.240075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 573/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Jun 20 18:36:31 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:36:33.763639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d872572-eb83-4460-86b0-05db8a22635d None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:33.764211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d872572-eb83-4460-86b0-05db8a22635d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:33.764211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d872572-eb83-4460-86b0-05db8a22635d None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:33.766671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 633/1206] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:33.771000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2295d-1384-4d7c-b704-67f57271d0da None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:33.771436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2295d-1384-4d7c-b704-67f57271d0da None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:33.771666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2295d-1384-4d7c-b704-67f57271d0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:33.793094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-0dd2295d-1384-4d7c-b704-67f57271d0da None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:33.793094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0dd2295d-1384-4d7c-b704-67f57271d0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:33.879240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 574/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:36:33.903444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d872572-eb83-4460-86b0-05db8a22635d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:34.033420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d872572-eb83-4460-86b0-05db8a22635d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:34.082871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:34.083792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:34.084087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:34.084374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:34.098205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:36:34.106116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:34.107177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:34.113164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 634/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:34.114035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2295d-1384-4d7c-b704-67f57271d0da None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:34.167173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:34.257214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2295d-1384-4d7c-b704-67f57271d0da None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:34.302115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:34.302782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:34.303154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:34.303460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:34.304209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:34.304525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:34.305942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:34.314993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 575/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:36:34.322179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:34.387253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:34.449736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637416-5c74-4a88-bdb2-41be037bc2cf None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:34.495408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:34.496570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:34.496935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:34.497145 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:34.511349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:34.512819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:34.531439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:34.532700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:34.534166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:34.534166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:34.534166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:34.534166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:34.534166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 635/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:34.539604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:34.652365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:34.656233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2424985-f496-40fb-89db-dcf76b956c18 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:34.695677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:34.696464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:34.696746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:34.697024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:34.697760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:34.699099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:34.700499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:34.719136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:34.719583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 576/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:34.834041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c64c1a-7e8a-48b6-9168-2d1385f49f59 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:34.835926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:34.872073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:34.872889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:34.873177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:34.873463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:34.881227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:34.883764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:36:34.898684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:34.899966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:34.900928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 636/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:34.905772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:35.023550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad42a1c-5fd5-489a-976f-74e736b244cd None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:35.069763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:35.070446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:35.070735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:35.071040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:35.072166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:35.072655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:35.074394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:35.099051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 577/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Jun 20 18:36:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:35.105912 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:35.218868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce757fb2-ad93-4b59-ade8-0eb332f586dd None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:35.259566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:35.260403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:35.260702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:35.260993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:35.296015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:35.351888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:35.353927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:35.494826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 637/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:36:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:36:35.501366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:35.525226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:35.620438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88856e4-56d4-4bc2-af04-3b9d53f38844 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:35.665893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:35.667144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:35.667756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:35.668135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:35.682898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:35.684654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:35.713251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:35.714263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:35.715226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:35.715226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:35.715226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:35.715226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:35.719195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 578/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:35.720888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:35.786758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:35.827415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2369-c882-4e09-94cd-065273aa4ec8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:35.867981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:35.868811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:35.869056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:35.869342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:35.870066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:35.870464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:35.872131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:35.885330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 638/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:35.890772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:35.976264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:36.010345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e46c58-467a-42a8-9a3c-53c9ee6c450a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:36.050207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:36.051025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:36.051304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:36.051593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:36.059713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:36.061283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:36:36.076141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:36.077239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:36.078397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:36.082263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 579/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:36.083209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:36.203757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a81eb-5492-44e7-ab9c-f5a957ad289c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:36.229071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:36.242406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cfde0-b40f-4089-bf18-ebb6ae4d5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:36.243198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfde0-b40f-4089-bf18-ebb6ae4d5e7c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:36.243489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfde0-b40f-4089-bf18-ebb6ae4d5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:36.243767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfde0-b40f-4089-bf18-ebb6ae4d5e7c None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:36.244680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cfde0-b40f-4089-bf18-ebb6ae4d5e7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:36.245121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cfde0-b40f-4089-bf18-ebb6ae4d5e7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:36.246594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cfde0-b40f-4089-bf18-ebb6ae4d5e7c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:36.260978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 639/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:36.267368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:36.407851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11ecd2-6919-4515-83cc-0ee09b57c21c None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:36.443196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:36.450182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8580-13d0-478f-9aec-6df4e446ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:36.451075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8580-13d0-478f-9aec-6df4e446ed84 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:36.451441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8580-13d0-478f-9aec-6df4e446ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:36.451817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8580-13d0-478f-9aec-6df4e446ed84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:36.452932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8580-13d0-478f-9aec-6df4e446ed84 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=3adb6160201d4470a90f3fddc3d6b043) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:36.453369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8580-13d0-478f-9aec-6df4e446ed84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:36.455716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8580-13d0-478f-9aec-6df4e446ed84 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:36.464831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 580/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:36:36 2022] GET /identity/v3/role_assignments?user.id=3adb6160201d4470a90f3fddc3d6b043&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:38.786294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e9df-0a1c-4083-a745-978f46f57cc7 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:38.786876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e9df-0a1c-4083-a745-978f46f57cc7 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:38.787064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e9df-0a1c-4083-a745-978f46f57cc7 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:38.788323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 640/1220] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:38.793793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bca526-6544-4ebf-98ea-6981abf16d0e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:38.794230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bca526-6544-4ebf-98ea-6981abf16d0e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:38.794369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bca526-6544-4ebf-98ea-6981abf16d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:38.811806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-68bca526-6544-4ebf-98ea-6981abf16d0e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:38.813040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-68bca526-6544-4ebf-98ea-6981abf16d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:38.880137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 581/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:36:38.904206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624e9df-0a1c-4083-a745-978f46f57cc7 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:39.024330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624e9df-0a1c-4083-a745-978f46f57cc7 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:39.065069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:39.065958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:39.066247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:39.066531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:39.077436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:36:39.085829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:39.086972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:39.087950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 641/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:36:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:39.093468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bca526-6544-4ebf-98ea-6981abf16d0e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:39.200915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bca526-6544-4ebf-98ea-6981abf16d0e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:39.225703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:39.238304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:39.239009 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:39.239300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:39.239578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:39.240329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:39.240637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:39.242178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:39.250619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 582/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:39.256531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:39.308925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:39.374432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47185f-ba54-4d95-9e4c-a81450bc3e58 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:39.413369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:39.414382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:39.414784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:39.415117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:39.428485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:39.430441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:39.449655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:39.450770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:39.451721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:39.451721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:39.451721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:39.451721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:39.451721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 642/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:39.458623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:39.579157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292780f-9e7f-4f1d-8e16-0d4e07ca57f4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:39.615149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:39.615827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:39.616115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:39.616397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:39.617124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:39.617437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:39.618821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:39.631603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 583/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:39.638000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:39.742620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:39.750287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d326779-9419-40c7-9f5d-3e5d78aa16a3 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:39.786833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:39.787670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:39.787956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:39.788232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:39.796944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:39.798515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:36:39.813511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:39.814558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:39.815576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 643/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:36:39.820930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:39.871388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:39.934100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40099b-7ab1-4118-bb1e-9b4badd3b868 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:39.979589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:39.980453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:39.980782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:39.981166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:39.982274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:39.982792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:39.984672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:40.007551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 584/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Jun 20 18:36:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:36:40.013385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:40.134219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368021-ae9d-44f6-9ef4-65a2369be1eb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:40.170303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:40.171138 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:40.171422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:40.171698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:40.185934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:40.187846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:40.206563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:40.207703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:40.213531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:40.213531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:40.213531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:40.213531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:40.213531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 644/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:36:40.213888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:40.322546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937334d-f31e-4ee3-b94e-f31f55c11766 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:40.325006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:40.364771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:40.365478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:40.365733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:40.366010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:40.366752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:40.367082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:40.368453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:40.379911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 585/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:40.385644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:40.395358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:40.509968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79a41-49ed-4859-9a79-f2937911c7b1 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:40.547100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:40.547932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:40.548226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:40.548552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:40.556971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:40.558423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:36:40.574651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:40.575695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:40.576684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 645/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:40.583909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:40.712585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2c53-9fe1-4c5f-98bc-549c11438202 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:40.750139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a9e4-d87d-4d49-b154-e2833fb89258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:40.750959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a9e4-d87d-4d49-b154-e2833fb89258 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:40.751285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a9e4-d87d-4d49-b154-e2833fb89258 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:40.752184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a9e4-d87d-4d49-b154-e2833fb89258 None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:40.753078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a9e4-d87d-4d49-b154-e2833fb89258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:40.753399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a9e4-d87d-4d49-b154-e2833fb89258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:40.755018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a9e4-d87d-4d49-b154-e2833fb89258 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:40.769429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 586/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:40.775346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:40.852901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:40.894029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e56d31-e600-46e7-a29b-8bf8804937c0 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:40.930720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397e2d6-f27a-43e7-8ac9-4de7b68590a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:40.931649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397e2d6-f27a-43e7-8ac9-4de7b68590a0 None admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:40.931933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397e2d6-f27a-43e7-8ac9-4de7b68590a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:40.932207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397e2d6-f27a-43e7-8ac9-4de7b68590a0 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/3adb6160201d4470a90f3fddc3d6b043/roles/7734ba45f7b24e8b83baeec31f464417` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:40.946970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397e2d6-f27a-43e7-8ac9-4de7b68590a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=3adb6160201d4470a90f3fddc3d6b043, role_id=7734ba45f7b24e8b83baeec31f464417)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:40.948455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397e2d6-f27a-43e7-8ac9-4de7b68590a0 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:40.962894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 646/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:36:40 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/3adb6160201d4470a90f3fddc3d6b043/roles/7734ba45f7b24e8b83baeec31f464417 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:36:43.009708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac62a-2958-4daf-9cee-cea35065ef0e None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:43.010232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac62a-2958-4daf-9cee-cea35065ef0e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:43.010352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac62a-2958-4daf-9cee-cea35065ef0e None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:43.011696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 587/1233] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:43.018458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ef90-6059-47f3-9281-384fc0a6b423 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:43.018905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ef90-6059-47f3-9281-384fc0a6b423 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:43.019091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ef90-6059-47f3-9281-384fc0a6b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:43.038125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-30a6ef90-6059-47f3-9281-384fc0a6b423 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:43.039670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-30a6ef90-6059-47f3-9281-384fc0a6b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:43.120172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 647/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 18:36:43.146975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ac62a-2958-4daf-9cee-cea35065ef0e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:43.175145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:43.260407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ac62a-2958-4daf-9cee-cea35065ef0e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:43.299845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:43.300797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:43.301124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:43.301476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:43.313891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:36:43.323334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:43.324372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:43.325330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 588/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Jun 20 18:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:43.331878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6ef90-6059-47f3-9281-384fc0a6b423 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:43.385526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:43.442760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6ef90-6059-47f3-9281-384fc0a6b423 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:43.484201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:43.485050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:43.485287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:43.485620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:43.487082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] RBAC: Adding query filter params (name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:43.487501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:43.489089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:43.499411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 648/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Jun 20 18:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:43.507266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:43.608766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:43.627224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11222-f075-45fd-b6f9-5ff384c65ea6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:43.665773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:43.666541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:43.666828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:43.667155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:43.678578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:43.680092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:43.699360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:43.700346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:43.701247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:43.701247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:43.701247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:43.701247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:43.701247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 589/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:43.707857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:43.812628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf75ba-d1d1-4900-bd3a-998bd8b30e4a None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:43.822765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:43.849704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:43.850420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:43.850668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:43.850977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:43.851706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:43.852014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:43.853380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:43.865425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 649/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:43.871142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:43.978123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d20d7-3744-4686-91a5-8d3ca754e109 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:44.013592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:44.014614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:44.014887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:44.015164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:44.018512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:44.024839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:44.026311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:36:44.041435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:44.042622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:44.043643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 590/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:44.049522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:44.152537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eadbfb-cf13-49d5-9ae2-07b042186798 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:44.187205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:44.187883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:44.188168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:44.188445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:44.189339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:44.189654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:44.191103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:44.209101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 650/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Jun 20 18:36:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:44.215208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:44.318393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d639a-2c21-472a-ad4b-b3787e1f7784 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:44.359397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:44.360076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:44.360363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:44.360641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:44.425628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:44.433111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:44.434589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:44.555269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 591/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:36:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 18:36:44.555462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:44.584625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:44.667483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc95f30-74dc-4cb8-8550-74e9f5c97d98 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:44.707242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:44.707983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:44.708277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:44.708542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:44.720832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:44.722662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:44.743586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:44.744629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:44.745553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:44.745553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:44.745553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:44.745553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:44.745553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 651/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:44.752536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:44.854097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:44.860151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1d87-aa2e-4e3b-b6bc-d86dc638b121 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:44.896852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:44.897539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:44.897838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:44.898127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:44.898850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:44.899236 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:44.900580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:44.912791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 592/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:44.918468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:44.998281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:45.022047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee705bbf-d0bb-4d67-ac9c-9b9f1b4ad330 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:45.059802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:45.060563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:45.060891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:45.061172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:45.068583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:45.070019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:36:45.083992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:45.085113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:45.086144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 652/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:36:45.091938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:45.206193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd058fb-4696-48a2-84db-a9130f93b3f9 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:45.244082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086265-d64b-4115-97f7-67308d24e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:45.244767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086265-d64b-4115-97f7-67308d24e5ad None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:45.245052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086265-d64b-4115-97f7-67308d24e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:45.245332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086265-d64b-4115-97f7-67308d24e5ad None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:45.246131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086265-d64b-4115-97f7-67308d24e5ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:45.246446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086265-d64b-4115-97f7-67308d24e5ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:45.247911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086265-d64b-4115-97f7-67308d24e5ad None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:45.266427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 593/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:45.267535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:45.371702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507278d9-8a21-49ca-ba88-2f68e875b4ac None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:45.406290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cac44-5274-4de1-b70f-360946207ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:45.407243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cac44-5274-4de1-b70f-360946207ea1 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:45.408035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cac44-5274-4de1-b70f-360946207ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:45.408333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cac44-5274-4de1-b70f-360946207ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:45.409416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cac44-5274-4de1-b70f-360946207ea1 None admin] RBAC: Adding query filter params (role.id=7734ba45f7b24e8b83baeec31f464417, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=3adb6160201d4470a90f3fddc3d6b043) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:45.409724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cac44-5274-4de1-b70f-360946207ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:45.411185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cac44-5274-4de1-b70f-360946207ea1 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:45.417571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 653/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:36:45 2022] GET /identity/v3/role_assignments?user.id=3adb6160201d4470a90f3fddc3d6b043&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=7734ba45f7b24e8b83baeec31f464417 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:47.576078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83512f-2b1e-4f61-8f62-a10032dfa51f None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:47.576629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83512f-2b1e-4f61-8f62-a10032dfa51f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:47.576822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83512f-2b1e-4f61-8f62-a10032dfa51f None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:47.578487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 594/1247] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:47.584628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b04867-ca83-4f14-8808-7aaeabd69ab0 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:47.585045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b04867-ca83-4f14-8808-7aaeabd69ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:47.585201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b04867-ca83-4f14-8808-7aaeabd69ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:47.590204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:47.603630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-85b04867-ca83-4f14-8808-7aaeabd69ab0 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:47.604905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-85b04867-ca83-4f14-8808-7aaeabd69ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:47.680027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 654/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:36:47.706934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83512f-2b1e-4f61-8f62-a10032dfa51f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:47.727454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:47.838223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83512f-2b1e-4f61-8f62-a10032dfa51f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:47.876537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:47.877877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:47.878168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:47.878452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:47.889114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:36:47.899030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:47.900227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:36:47.901089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:47.905617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 595/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:47.906543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b04867-ca83-4f14-8808-7aaeabd69ab0 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:48.024030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b04867-ca83-4f14-8808-7aaeabd69ab0 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:48.060917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:48.067302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:48.068122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:48.068420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:48.068725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:48.069592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:48.069899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:48.071504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:48.085270 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 655/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:48.087213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:48.173956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:48.200162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b4a2-79f4-4cdc-b020-01c69621ddb4 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:48.233764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:48.234576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:48.234888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:48.235182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:48.246277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:48.247757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:48.264404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:48.265443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:48.271446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:48.271446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:48.271446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:48.271446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:48.271446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 596/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:36:48.271787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:48.390487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da6158-e97a-452a-824e-308402fbeaab None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:48.429828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:48.430521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:48.430818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:48.431137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:48.431876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:48.432200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:48.433580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:48.446595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 656/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:48.452956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:48.569864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962359d5-1174-426b-8fef-ef98c9909954 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:48.596293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:48.604426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:48.605238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:48.605530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:48.605808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:48.613870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:48.615417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:36:48.631188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:48.632217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:48.633186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 597/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:48.638399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:48.696311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:48.752368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1cc76-0b5c-41f5-8852-1f5f83c91e35 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:48.794022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:48.794820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:48.795181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:48.795455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:48.796336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:48.796729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:48.798278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:48.822117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 657/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Jun 20 18:36:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:48.823387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:48.937637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2b24-7565-4825-878b-79016d09bfa8 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:48.975961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:48.976537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:48.976829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:48.977112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:49.043008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:49.056351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:49.057823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:49.162227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 598/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:36:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:36:49.168156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:49.271400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbae45-752f-441b-b931-73d67afbe89c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:49.286072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:49.308316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:49.309132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:49.309415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:49.309691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:49.321083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:49.322550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:49.340964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:49.342137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:49.343211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:49.343211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:49.343211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:49.343211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:49.343211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 658/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:49.348148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:49.438613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:49.450965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900f5eb-40c3-4280-831a-b362d0590e95 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:49.494240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:49.495357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:49.495835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:49.496137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:49.497190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:49.497705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:49.499847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:49.518996 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 599/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:49.523629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:49.628492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939af2-b517-40d6-a350-984887f400ca None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:49.663256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:49.664073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:49.664370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:49.664652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:49.671355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:49.672803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:36:49.686854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:49.687963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:49.689637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 659/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:49.694617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:49.791419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8994fe9-1ab0-452a-810a-66d05751f6a6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:49.824082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa169-7b64-49ea-97c9-eb4d0998894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:49.824745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa169-7b64-49ea-97c9-eb4d0998894a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:49.825032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa169-7b64-49ea-97c9-eb4d0998894a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:49.825314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa169-7b64-49ea-97c9-eb4d0998894a None admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:49.826104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa169-7b64-49ea-97c9-eb4d0998894a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:49.826416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa169-7b64-49ea-97c9-eb4d0998894a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:49.827886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa169-7b64-49ea-97c9-eb4d0998894a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:49.839571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 600/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:49.846046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:49.871549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:49.943600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e38b22-ca47-4187-9473-516d4e355f0d None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:49.975717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba650f3e-c224-41d3-adb6-43a6f95d6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:49.976362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650f3e-c224-41d3-adb6-43a6f95d6b73 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:49.976650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650f3e-c224-41d3-adb6-43a6f95d6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:49.976933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650f3e-c224-41d3-adb6-43a6f95d6b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:49.977765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba650f3e-c224-41d3-adb6-43a6f95d6b73 None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=3adb6160201d4470a90f3fddc3d6b043) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:49.978080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba650f3e-c224-41d3-adb6-43a6f95d6b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:49.979542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba650f3e-c224-41d3-adb6-43a6f95d6b73 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:49.984818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 660/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:36:49 2022] GET /identity/v3/role_assignments?user.id=3adb6160201d4470a90f3fddc3d6b043&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:51.953369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f758-0ca1-444a-a142-126ef6e7b3f9 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:51.953889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f758-0ca1-444a-a142-126ef6e7b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:51.953974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f758-0ca1-444a-a142-126ef6e7b3f9 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:51.955339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 601/1261] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:51.960348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a238e-d1de-4be7-bca5-2cb31728d778 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:51.960715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a238e-d1de-4be7-bca5-2cb31728d778 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:51.960924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a238e-d1de-4be7-bca5-2cb31728d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:51.977841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6b0a238e-d1de-4be7-bca5-2cb31728d778 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:51.978981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6b0a238e-d1de-4be7-bca5-2cb31728d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:52.042880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 661/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:36:52.065875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f758-0ca1-444a-a142-126ef6e7b3f9 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:52.076449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:52.163420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f758-0ca1-444a-a142-126ef6e7b3f9 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:52.195482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:52.196261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:52.196546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:52.196825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:52.206418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:36:52.213953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:52.215080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:52.216140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 602/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:52.221489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a238e-d1de-4be7-bca5-2cb31728d778 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:52.240024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:52.317952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a238e-d1de-4be7-bca5-2cb31728d778 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:52.350756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:52.351448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:52.351738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:52.352026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:52.352772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:52.353081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:52.354449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:52.362841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 662/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:52.368234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:52.439422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:52.474762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e23637-3eea-4afd-a1a0-30f6a1cf80bb None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:52.515800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:52.517883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:52.518238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:52.518564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:52.530509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:52.532620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:52.553854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:52.555077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:52.556254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:52.556254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:52.556254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:52.556254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:52.556254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 603/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:52.560861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:52.639359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:52.658075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733290b0-1ac0-4825-8744-9bcc2f63fe60 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:52.690412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:52.691097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:52.691383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:52.692410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:52.692410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:52.692706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:52.694053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:52.705634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 663/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:52.711352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:52.809148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224d1a-fdc6-4064-b6e8-b8651a488dc0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:52.828107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:52.841894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:52.842700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:52.843026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:52.843310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:52.851817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:52.853254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:36:52.868103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:52.869186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:52.870522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 604/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:52.874951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:52.968643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32801c3b-93e2-488c-9a5a-cd01d6230b92 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:53.001430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:53.002094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:53.002379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:53.002657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:53.003510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:53.003821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:53.005228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:53.013459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:53.022178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 664/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Jun 20 18:36:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:53.027552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:53.123811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7d26d-c5de-409c-87b5-301cd405ba84 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:53.155705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:53.156492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:53.156779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:53.157313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:53.168044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:53.169466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:53.185752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:53.186908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:53.188036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:53.188036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:53.188036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:53.188036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:53.188036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 605/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:53.192511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:53.287254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52437-7a10-45fb-ab94-c23d9710657b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:53.318773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:53.319452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:53.319741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:53.320019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:53.320733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:53.321038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:53.322385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:53.333703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 665/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:53.338978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:53.369870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:53.434997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e9e79-8798-4140-af30-c8943014b554 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:53.467875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:53.469243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:53.469472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:53.470535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:53.478884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:53.480650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:36:53.502006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:53.503388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:53.504380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 606/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:53.509931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:53.569620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:53.610639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680c4ff-86d3-42df-9919-2173f91b6370 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:53.643134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f0d3a-ad90-4329-91f1-852b50b0d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:53.643783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f0d3a-ad90-4329-91f1-852b50b0d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:53.644068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f0d3a-ad90-4329-91f1-852b50b0d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:53.644348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f0d3a-ad90-4329-91f1-852b50b0d5d3 None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:53.645132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f0d3a-ad90-4329-91f1-852b50b0d5d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:53.645442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f0d3a-ad90-4329-91f1-852b50b0d5d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:53.646860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f0d3a-ad90-4329-91f1-852b50b0d5d3 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:53.658841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 666/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:53.664701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:53.752646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:53.761213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0d181-6ab3-4b4c-bfdc-210c0c7c5830 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:53.794361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29256ca-54f9-49fd-ae31-3e3f25dda450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:53.795325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29256ca-54f9-49fd-ae31-3e3f25dda450 None admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:53.795619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29256ca-54f9-49fd-ae31-3e3f25dda450 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:53.795903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29256ca-54f9-49fd-ae31-3e3f25dda450 None admin] PATH_INFO: `/v3/projects/070a4902142c4cef846767b6bbe1644d/users/3adb6160201d4470a90f3fddc3d6b043/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:53.798423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29256ca-54f9-49fd-ae31-3e3f25dda450 None admin] RBAC: Authorizing `identity:create_grant(project_id=070a4902142c4cef846767b6bbe1644d, user_id=3adb6160201d4470a90f3fddc3d6b043, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:53.799910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29256ca-54f9-49fd-ae31-3e3f25dda450 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:53.812701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 607/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Jun 20 18:36:53 2022] PUT /identity/v3/projects/070a4902142c4cef846767b6bbe1644d/users/3adb6160201d4470a90f3fddc3d6b043/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:36:55.801001 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb3a8-d517-4101-95e5-f41395e11258 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:55.801538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb3a8-d517-4101-95e5-f41395e11258 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:55.801538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb3a8-d517-4101-95e5-f41395e11258 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:55.802957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 667/1274] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:55.808099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d22e2-2001-4843-be9d-d26a37afb78f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:55.808474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d22e2-2001-4843-be9d-d26a37afb78f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:55.808667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d22e2-2001-4843-be9d-d26a37afb78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:55.825025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ee6d22e2-2001-4843-be9d-d26a37afb78f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:55.826191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ee6d22e2-2001-4843-be9d-d26a37afb78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:55.891095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 608/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:36:55.915300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb3a8-d517-4101-95e5-f41395e11258 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:56.012202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb3a8-d517-4101-95e5-f41395e11258 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:56.029382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:56.046308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:56.047132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:56.047421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:56.047702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:56.057496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 18:36:56.065220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:56.066312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:56.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 668/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Jun 20 18:36:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:56.072161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d22e2-2001-4843-be9d-d26a37afb78f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:56.149476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:56.168152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d22e2-2001-4843-be9d-d26a37afb78f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:56.200776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:56.201438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:56.201726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:56.202005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:56.202751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:56.203096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:56.205005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:56.212714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 609/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Jun 20 18:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:56.218323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:56.314563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220fcb0-60dd-4fde-aa05-f9439a2a49e5 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:56.347010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:56.347792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:56.348080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:56.348358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:56.358391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:56.359858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:56.376381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:56.377271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:56.378207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:56.378207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:56.378207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:56.378207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:56.378207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 669/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:56.382982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:56.479991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1210cff-7171-4f90-9901-b886a1ecc0a6 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:56.518765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:56.519638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:56.520049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:56.520624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:56.521795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:56.522419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:56.524381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:56.538711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 610/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:56.544392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:56.574748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:56.641735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62b937-a626-411b-85b0-441f03e7de9b None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:56.674029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:56.674820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:56.675131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:56.675411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:56.682545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:56.684014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 18:36:56.698503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:56.699653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 18:36:56.700787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:36:56.703060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 670/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:56.705801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:56.709531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:56.801871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b1e-6f9f-4d71-b5d5-5c95280f9641 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:56.834051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:56.834661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:56.834972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:56.835271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:56.836093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:56.836401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:56.837807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:56.853943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 611/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Jun 20 18:36:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:56.859544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:56.946760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:56.956205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e77e8-c750-4566-9527-fb99bc169a63 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:56.987997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:56.988631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:56.988918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:56.989195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:57.052876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:57.054303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:57.137296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:57.147551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 671/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Jun 20 18:36:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 18:36:57.153176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:57.212811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:57.249926 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbaddf-f0e9-4b85-8bdb-4bbaa4e0cf0a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:57.283419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:57.284205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:57.284493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:57.284777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:57.294420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:57.295884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 18:36:57.312720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:57.314318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:57.315343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 18:36:57.315343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 18:36:57.315343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 18:36:57.315343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:57.315343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 612/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 18:36:57.319883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:57.415198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feae842-ec3a-42bd-9ba3-e7a89620efe6 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:57.447977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:57.448637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:57.448921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:57.449199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:57.449915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:57.450223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:57.451606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:57.462894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 672/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Jun 20 18:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:57.468253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:57.564324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516338-eb30-41d5-bcc7-1c754687890a None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:57.577532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:57.597245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:57.598038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:57.598325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:57.598604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:57.605274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:57.606715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 18:36:57.620606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application with Lock( Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:36:57.621685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: ERROR keystone.server.flask.application Jun 20 18:36:57.622813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 613/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Jun 20 18:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:36:57.628275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:57.676404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:36:57.727027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07256430-08ea-47b5-aab8-735a5b8a5cfb None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:57.759558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8429-710e-4085-ad85-fa589589ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:57.760215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8429-710e-4085-ad85-fa589589ab8c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:57.760499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8429-710e-4085-ad85-fa589589ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:57.760776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8429-710e-4085-ad85-fa589589ab8c None admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:57.761553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8429-710e-4085-ad85-fa589589ab8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:57.761862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8429-710e-4085-ad85-fa589589ab8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:57.763305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8429-710e-4085-ad85-fa589589ab8c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:57.774681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 673/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Jun 20 18:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:57.780707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:36:57.876807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57a27e-7fac-43f9-8c03-4cd7960a44a0 None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:36:57.908034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75b1f-3cf8-4426-9ba2-230713b2064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:36:57.908666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75b1f-3cf8-4426-9ba2-230713b2064c None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:57.908951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75b1f-3cf8-4426-9ba2-230713b2064c None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:57.909227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75b1f-3cf8-4426-9ba2-230713b2064c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:57.910047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75b1f-3cf8-4426-9ba2-230713b2064c None admin] RBAC: Adding query filter params (role.id=9e750b1ee7f949dfa2095cc5f825af30, scope.project.id=070a4902142c4cef846767b6bbe1644d, user.id=3adb6160201d4470a90f3fddc3d6b043) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:36:57.910355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75b1f-3cf8-4426-9ba2-230713b2064c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:36:57.911793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c75b1f-3cf8-4426-9ba2-230713b2064c None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:36:57.917329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 614/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Jun 20 18:36:57 2022] GET /identity/v3/role_assignments?user.id=3adb6160201d4470a90f3fddc3d6b043&scope.project.id=070a4902142c4cef846767b6bbe1644d&role.id=9e750b1ee7f949dfa2095cc5f825af30 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:36:59.929323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d6a52-bb54-4855-93c5-43b08c4ed392 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:59.929854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d6a52-bb54-4855-93c5-43b08c4ed392 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:59.929969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d6a52-bb54-4855-93c5-43b08c4ed392 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:59.931299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 674/1288] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:36:59.936319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447a4ce-39c9-4b0b-9871-45990da85671 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:36:59.936718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447a4ce-39c9-4b0b-9871-45990da85671 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:36:59.936882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447a4ce-39c9-4b0b-9871-45990da85671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:36:59.953762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d447a4ce-39c9-4b0b-9871-45990da85671 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:36:59.954995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d447a4ce-39c9-4b0b-9871-45990da85671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:36:59.983063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:00.019847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 615/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:36:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:37:00.042169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d6a52-bb54-4855-93c5-43b08c4ed392 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:00.140748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d6a52-bb54-4855-93c5-43b08c4ed392 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:00.151062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:00.174885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:00.175718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:00.176007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:00.176287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:00.176941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:00.178305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:37:00.189995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:37:00.191236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:00.192323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 675/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:37:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:37:00.196929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447a4ce-39c9-4b0b-9871-45990da85671 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:00.290856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447a4ce-39c9-4b0b-9871-45990da85671 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:00.323192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94a868-fab5-454a-94bc-6d49ec994123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:00.323844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94a868-fab5-454a-94bc-6d49ec994123 None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:00.324133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94a868-fab5-454a-94bc-6d49ec994123 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:00.324413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94a868-fab5-454a-94bc-6d49ec994123 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:00.325113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94a868-fab5-454a-94bc-6d49ec994123 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:37:00.325420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94a868-fab5-454a-94bc-6d49ec994123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:00.326766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94a868-fab5-454a-94bc-6d49ec994123 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:00.331440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 616/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Jun 20 18:37:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:37:00.336783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:00.434053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552936b-aea6-4a6d-8076-c18913ef85e8 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:00.466058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9134c-ee45-43e2-82ff-7ff8789fffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:00.467024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9134c-ee45-43e2-82ff-7ff8789fffd6 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:00.467395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9134c-ee45-43e2-82ff-7ff8789fffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:00.467722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9134c-ee45-43e2-82ff-7ff8789fffd6 None admin] PATH_INFO: `/v3/services` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:00.468677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9134c-ee45-43e2-82ff-7ff8789fffd6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:37:00.469142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9134c-ee45-43e2-82ff-7ff8789fffd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:00.471629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9134c-ee45-43e2-82ff-7ff8789fffd6 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:00.477347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 676/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Jun 20 18:37:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:37:02.474285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c0b97-f063-4a67-9e70-610acea129f9 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:02.474824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c0b97-f063-4a67-9e70-610acea129f9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:02.475011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c0b97-f063-4a67-9e70-610acea129f9 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:02.476661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 617/1293] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:37:02.481955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99794049-be23-44b8-b5d3-8cb62c4c9bfd None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:02.482431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99794049-be23-44b8-b5d3-8cb62c4c9bfd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:02.482522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99794049-be23-44b8-b5d3-8cb62c4c9bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:02.499618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-99794049-be23-44b8-b5d3-8cb62c4c9bfd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:37:02.500819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-99794049-be23-44b8-b5d3-8cb62c4c9bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:37:02.529151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:02.566212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 677/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:37:02.588136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c0b97-f063-4a67-9e70-610acea129f9 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:02.619093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:02.687085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c0b97-f063-4a67-9e70-610acea129f9 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:02.721523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0605-aeb7-4932-88eb-9c9ab7f36e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:02.722208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0605-aeb7-4932-88eb-9c9ab7f36e11 None admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:02.722576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0605-aeb7-4932-88eb-9c9ab7f36e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:02.722867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0605-aeb7-4932-88eb-9c9ab7f36e11 None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:02.723635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0605-aeb7-4932-88eb-9c9ab7f36e11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:02.725056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0605-aeb7-4932-88eb-9c9ab7f36e11 None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:02.738767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 618/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Jun 20 18:37:02 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:37:04.716885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34138a-1ac6-4130-9f4e-600f3bc2f20a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:04.717332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34138a-1ac6-4130-9f4e-600f3bc2f20a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:04.717459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34138a-1ac6-4130-9f4e-600f3bc2f20a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:04.718854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 678/1296] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:37:04.724345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0058-7438-4ba5-8498-6fda8487fe93 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:04.724761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0058-7438-4ba5-8498-6fda8487fe93 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:04.724928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0058-7438-4ba5-8498-6fda8487fe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:04.741850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-8ddb0058-7438-4ba5-8498-6fda8487fe93 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:37:04.743067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8ddb0058-7438-4ba5-8498-6fda8487fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:37:04.813550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 619/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:37:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:37:04.835478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34138a-1ac6-4130-9f4e-600f3bc2f20a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:04.934305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34138a-1ac6-4130-9f4e-600f3bc2f20a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:04.966983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:04.967736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:04.968025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:04.968314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:04.969022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:04.970984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:37:04.982806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:37:04.983986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:04.984880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 679/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:37:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:37:04.990470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0058-7438-4ba5-8498-6fda8487fe93 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:05.008956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:05.088437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0058-7438-4ba5-8498-6fda8487fe93 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:05.121109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:05.121771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:05.122066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:05.122353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:05.123099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:37:05.123413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:05.124780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:05.129852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 620/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Jun 20 18:37:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:37:05.135550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:05.167253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:05.236792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93755ff1-7207-4393-b776-7d7517441476 None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:05.274760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648b31f-30a7-4b08-b360-604d871d1f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:05.275456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648b31f-30a7-4b08-b360-604d871d1f1f None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:05.275750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648b31f-30a7-4b08-b360-604d871d1f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:05.276036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648b31f-30a7-4b08-b360-604d871d1f1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:05.276831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648b31f-30a7-4b08-b360-604d871d1f1f None admin] RBAC: Adding query filter params (interface=public, service_id=ec13c3a2f2424247976e71368089cbc8, region_id=RegionOne) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:37:05.277150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648b31f-30a7-4b08-b360-604d871d1f1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:05.278523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648b31f-30a7-4b08-b360-604d871d1f1f None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:05.284433 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 680/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Jun 20 18:37:05 2022] GET /identity/v3/endpoints?service_id=ec13c3a2f2424247976e71368089cbc8&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:37:05.290145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:05.369158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:05.386825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e74b-a2e0-4c0f-9914-b2263e230e5e None admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:05.420386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227140-b6de-4170-b2e0-2d52720816cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:05.421051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227140-b6de-4170-b2e0-2d52720816cc None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:05.421340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227140-b6de-4170-b2e0-2d52720816cc None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:05.421620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227140-b6de-4170-b2e0-2d52720816cc None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:05.422301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227140-b6de-4170-b2e0-2d52720816cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:05.423699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227140-b6de-4170-b2e0-2d52720816cc None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:05.430279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 621/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Jun 20 18:37:05 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:37:07.430450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250aa8e-6c82-4665-a33a-c2de5507639b None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:07.431041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250aa8e-6c82-4665-a33a-c2de5507639b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:07.431041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250aa8e-6c82-4665-a33a-c2de5507639b None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:07.432415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 681/1302] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:37:07.437544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9061f7-b8a0-4c4b-b7a1-f8ee401e6438 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:07.437943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9061f7-b8a0-4c4b-b7a1-f8ee401e6438 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:07.438113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9061f7-b8a0-4c4b-b7a1-f8ee401e6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:07.454866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5b9061f7-b8a0-4c4b-b7a1-f8ee401e6438 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:37:07.456077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5b9061f7-b8a0-4c4b-b7a1-f8ee401e6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:37:07.531912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 622/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:37:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 18:37:07.561998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250aa8e-6c82-4665-a33a-c2de5507639b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:07.652805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:07.660350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250aa8e-6c82-4665-a33a-c2de5507639b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:07.693539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:07.694271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:07.694556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:07.694832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:07.695529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:07.696897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 18:37:07.708713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 18:37:07.709904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application with Lock( Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self._enter() Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application return self.creator() Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application created_value = creator( Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: ERROR keystone.server.flask.application Jun 20 18:37:07.710980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 682/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Jun 20 18:37:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 18:37:07.715994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9061f7-b8a0-4c4b-b7a1-f8ee401e6438 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:07.789241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:07.812072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9061f7-b8a0-4c4b-b7a1-f8ee401e6438 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:07.843781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79ed88-ee9a-448a-ae0a-87b895b032fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:07.844950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ed88-ee9a-448a-ae0a-87b895b032fe None admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:07.845238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ed88-ee9a-448a-ae0a-87b895b032fe None admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:07.845518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ed88-ee9a-448a-ae0a-87b895b032fe None admin] PATH_INFO: `/v3/services` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:07.846224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79ed88-ee9a-448a-ae0a-87b895b032fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:37:07.846533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79ed88-ee9a-448a-ae0a-87b895b032fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:07.847928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79ed88-ee9a-448a-ae0a-87b895b032fe None admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:07.852907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 623/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Jun 20 18:37:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:37:07.858587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:37:07.954283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf90d04-20b5-48bb-b571-702bac52a04c None admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:37:07.987012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068427-0d4b-4fa1-a2b7-0f1226c277d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:37:07.987660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068427-0d4b-4fa1-a2b7-0f1226c277d4 None admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:37:07.987949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068427-0d4b-4fa1-a2b7-0f1226c277d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:37:07.988231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068427-0d4b-4fa1-a2b7-0f1226c277d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:37:07.988977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068427-0d4b-4fa1-a2b7-0f1226c277d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:37:07.990341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068427-0d4b-4fa1-a2b7-0f1226c277d4 None admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:37:08.008463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 683/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Jun 20 18:37:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:37:17.850077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=30 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:37:18.004328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:10.051126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560f240-9353-4d12-b34a-089d12778303 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:10.052214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560f240-9353-4d12-b34a-089d12778303 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:10.052725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560f240-9353-4d12-b34a-089d12778303 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:10.058290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 624/1307] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:10.059710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130048-b5ec-4bc7-b152-d98e5aa6d427 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:10.060141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130048-b5ec-4bc7-b152-d98e5aa6d427 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:10.060346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130048-b5ec-4bc7-b152-d98e5aa6d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:10.211200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-de130048-b5ec-4bc7-b152-d98e5aa6d427 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:10.212359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-de130048-b5ec-4bc7-b152-d98e5aa6d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:10.405816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 684/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:38:10.455149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6508c-7d96-485d-af95-bebbde03fd96 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:10.455954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6508c-7d96-485d-af95-bebbde03fd96 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:10.456483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6508c-7d96-485d-af95-bebbde03fd96 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:10.459983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 625/1309] 10.222.0.43 () {54 vars in 964 bytes} [Mon Jun 20 18:38:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:10.464346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e723e-eed0-4d8b-9c91-bdfc60ba8bd2 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:10.464641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e723e-eed0-4d8b-9c91-bdfc60ba8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:10.464928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e723e-eed0-4d8b-9c91-bdfc60ba8bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:10.582757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2d8e723e-eed0-4d8b-9c91-bdfc60ba8bd2 None None] MFA Rules not processed for user `b3d7fbf23c584c32a518abd0b5326229`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:10.584009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2d8e723e-eed0-4d8b-9c91-bdfc60ba8bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:10.606117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:10.715185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 685/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Mon Jun 20 18:38:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:10.723893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6508c-7d96-485d-af95-bebbde03fd96 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:10.725655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2ef6508c-7d96-485d-af95-bebbde03fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:10.940132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6508c-7d96-485d-af95-bebbde03fd96 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:11.022470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eba42a-dfb5-4c09-ac53-e4b857bd243d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:11.023209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eba42a-dfb5-4c09-ac53-e4b857bd243d service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:11.023502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eba42a-dfb5-4c09-ac53-e4b857bd243d service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:11.023790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eba42a-dfb5-4c09-ac53-e4b857bd243d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:11.025441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-95eba42a-dfb5-4c09-ac53-e4b857bd243d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:11.085539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:11.145135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eba42a-dfb5-4c09-ac53-e4b857bd243d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:11.146595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eba42a-dfb5-4c09-ac53-e4b857bd243d service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:11.166598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 626/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:13.522726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbb227-a6a4-4b3a-a76a-4159d647431d None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:13.523301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbb227-a6a4-4b3a-a76a-4159d647431d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:13.523301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbb227-a6a4-4b3a-a76a-4159d647431d None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:13.524713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 686/1312] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:13.529797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949acf4e-6551-42ea-9033-8f4c7dd06f29 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:13.530248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949acf4e-6551-42ea-9033-8f4c7dd06f29 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:13.530374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949acf4e-6551-42ea-9033-8f4c7dd06f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:13.618048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-949acf4e-6551-42ea-9033-8f4c7dd06f29 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:13.619430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-949acf4e-6551-42ea-9033-8f4c7dd06f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:13.723960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 627/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:13.761939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbb227-a6a4-4b3a-a76a-4159d647431d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:13.763572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d9fbb227-a6a4-4b3a-a76a-4159d647431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:13.866122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbb227-a6a4-4b3a-a76a-4159d647431d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:13.937470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:13.940165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90303dee-d07a-43be-93df-b2c02372e46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:13.941013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303dee-d07a-43be-93df-b2c02372e46f service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:13.941412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303dee-d07a-43be-93df-b2c02372e46f service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:13.941886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303dee-d07a-43be-93df-b2c02372e46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:13.943760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-90303dee-d07a-43be-93df-b2c02372e46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:14.056603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90303dee-d07a-43be-93df-b2c02372e46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:14.058055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90303dee-d07a-43be-93df-b2c02372e46f service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:14.077032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 687/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:16.377082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07703d-a330-48e3-836c-8ec0a66293af None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:16.377633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07703d-a330-48e3-836c-8ec0a66293af None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:16.377633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07703d-a330-48e3-836c-8ec0a66293af None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:16.379051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 628/1315] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:16.384251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeae024-11f0-4cc7-bb18-0531ca75065b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:16.384650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeae024-11f0-4cc7-bb18-0531ca75065b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:16.384822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeae024-11f0-4cc7-bb18-0531ca75065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:16.449352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-faeae024-11f0-4cc7-bb18-0531ca75065b None None] MFA Rules not processed for user `e717eaf0c527468cbf87f65de0f065e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:16.450611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-faeae024-11f0-4cc7-bb18-0531ca75065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:16.502559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:16.546750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 688/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:16.586057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07703d-a330-48e3-836c-8ec0a66293af None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:16.587601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7a07703d-a330-48e3-836c-8ec0a66293af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:16.597673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:16.688251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07703d-a330-48e3-836c-8ec0a66293af None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:16.759025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702039e-916e-42e8-a666-6bb2fbc81893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:16.759675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702039e-916e-42e8-a666-6bb2fbc81893 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:16.759959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702039e-916e-42e8-a666-6bb2fbc81893 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:16.760234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702039e-916e-42e8-a666-6bb2fbc81893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:16.761881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6702039e-916e-42e8-a666-6bb2fbc81893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:16.824122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:16.868615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702039e-916e-42e8-a666-6bb2fbc81893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:16.870036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702039e-916e-42e8-a666-6bb2fbc81893 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:16.888307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 629/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:19.417531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e50bd-5a40-4f90-be60-bb4b166bcccd None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:19.418069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e50bd-5a40-4f90-be60-bb4b166bcccd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:19.418184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e50bd-5a40-4f90-be60-bb4b166bcccd None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:19.419533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 689/1318] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:19.425235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee696-71e9-4147-885a-e86bab1a38e6 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:19.425652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee696-71e9-4147-885a-e86bab1a38e6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:19.425800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee696-71e9-4147-885a-e86bab1a38e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:19.490106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d67ee696-71e9-4147-885a-e86bab1a38e6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:19.491350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d67ee696-71e9-4147-885a-e86bab1a38e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:19.584168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 630/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:19.624165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e50bd-5a40-4f90-be60-bb4b166bcccd None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:19.625702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a82e50bd-5a40-4f90-be60-bb4b166bcccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:19.726783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e50bd-5a40-4f90-be60-bb4b166bcccd None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:19.798750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8a784-c078-4eaa-888d-a06fa37b8367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:19.799430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a784-c078-4eaa-888d-a06fa37b8367 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:19.799720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a784-c078-4eaa-888d-a06fa37b8367 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:19.800009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a784-c078-4eaa-888d-a06fa37b8367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:19.801663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7fd8a784-c078-4eaa-888d-a06fa37b8367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:19.808897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:19.907838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8a784-c078-4eaa-888d-a06fa37b8367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:19.909273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8a784-c078-4eaa-888d-a06fa37b8367 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:19.927214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 690/1320] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:22.619151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5bc59-be0d-4ea9-8b6b-a253a2f95a02 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:22.619715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5bc59-be0d-4ea9-8b6b-a253a2f95a02 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:22.619715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5bc59-be0d-4ea9-8b6b-a253a2f95a02 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:22.621094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 631/1321] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:22.626798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b96e84-e76d-41e0-aa20-5b6124cb7748 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:22.627278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b96e84-e76d-41e0-aa20-5b6124cb7748 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:22.627437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b96e84-e76d-41e0-aa20-5b6124cb7748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:22.692251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f6b96e84-e76d-41e0-aa20-5b6124cb7748 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:22.693450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f6b96e84-e76d-41e0-aa20-5b6124cb7748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:22.762348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:22.804726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 691/1322] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:22.856086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f747d-5b3a-47cf-81ff-34d7897c493f None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:22.856376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f747d-5b3a-47cf-81ff-34d7897c493f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:22.856658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f747d-5b3a-47cf-81ff-34d7897c493f None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:22.858042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 632/1323] 10.222.0.43 () {54 vars in 964 bytes} [Mon Jun 20 18:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:22.865023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c450-f927-42c2-b74f-3fb9596e41d5 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:22.865311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c450-f927-42c2-b74f-3fb9596e41d5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:22.865593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c450-f927-42c2-b74f-3fb9596e41d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:22.942783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-53a8c450-f927-42c2-b74f-3fb9596e41d5 None None] MFA Rules not processed for user `b3d7fbf23c584c32a518abd0b5326229`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:22.944012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-53a8c450-f927-42c2-b74f-3fb9596e41d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:23.018300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 692/1324] 10.222.0.43 () {58 vars in 1061 bytes} [Mon Jun 20 18:38:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:23.027520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f747d-5b3a-47cf-81ff-34d7897c493f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:23.029129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-694f747d-5b3a-47cf-81ff-34d7897c493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:23.049236 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:23.139693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f747d-5b3a-47cf-81ff-34d7897c493f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:23.214540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc5627-9aad-4782-b676-5d2b4bdbed54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:23.215232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc5627-9aad-4782-b676-5d2b4bdbed54 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:23.215525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc5627-9aad-4782-b676-5d2b4bdbed54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:23.215810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc5627-9aad-4782-b676-5d2b4bdbed54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:23.217467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b5dc5627-9aad-4782-b676-5d2b4bdbed54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:23.290135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:23.328287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc5627-9aad-4782-b676-5d2b4bdbed54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:23.330320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc5627-9aad-4782-b676-5d2b4bdbed54 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:23.349278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 633/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:25.665919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52b03-64e9-429f-b1b0-fa5a0b0a889a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:25.666510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52b03-64e9-429f-b1b0-fa5a0b0a889a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:25.666510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52b03-64e9-429f-b1b0-fa5a0b0a889a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:25.668112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 693/1326] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:25.673568 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5748-281d-4f96-be4d-cafaa27b56f8 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:25.674021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5748-281d-4f96-be4d-cafaa27b56f8 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:25.674127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c5748-281d-4f96-be4d-cafaa27b56f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:25.740269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6a1c5748-281d-4f96-be4d-cafaa27b56f8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:25.741479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6a1c5748-281d-4f96-be4d-cafaa27b56f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:25.845369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 634/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:25.881350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52b03-64e9-429f-b1b0-fa5a0b0a889a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:25.882881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-66f52b03-64e9-429f-b1b0-fa5a0b0a889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:25.942730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:25.987087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52b03-64e9-429f-b1b0-fa5a0b0a889a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:26.067373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206123d-ddd2-40ba-8afd-203e5bc947aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:26.067946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206123d-ddd2-40ba-8afd-203e5bc947aa service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:26.068269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206123d-ddd2-40ba-8afd-203e5bc947aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:26.068714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206123d-ddd2-40ba-8afd-203e5bc947aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:26.070258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e206123d-ddd2-40ba-8afd-203e5bc947aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:26.183260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:26.185667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206123d-ddd2-40ba-8afd-203e5bc947aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:26.187874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206123d-ddd2-40ba-8afd-203e5bc947aa service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:26.207308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 694/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:28.294728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea766c1d-ab1e-49b9-a438-35d895367869 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:28.295277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea766c1d-ab1e-49b9-a438-35d895367869 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:28.295398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea766c1d-ab1e-49b9-a438-35d895367869 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:28.296692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 635/1329] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:28.301979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4531a4c-a846-46c9-8771-4ed8eb78b822 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:28.302409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4531a4c-a846-46c9-8771-4ed8eb78b822 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:28.302548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4531a4c-a846-46c9-8771-4ed8eb78b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:28.389322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-c4531a4c-a846-46c9-8771-4ed8eb78b822 None None] MFA Rules not processed for user `e717eaf0c527468cbf87f65de0f065e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:28.390551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c4531a4c-a846-46c9-8771-4ed8eb78b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:28.491075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 695/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:28.527884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea766c1d-ab1e-49b9-a438-35d895367869 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:28.529436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ea766c1d-ab1e-49b9-a438-35d895367869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:28.561446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:28.633911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea766c1d-ab1e-49b9-a438-35d895367869 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:28.708093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857e0c-f28b-46be-8fbc-e6b10a56ed83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:28.708685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857e0c-f28b-46be-8fbc-e6b10a56ed83 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:28.708976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857e0c-f28b-46be-8fbc-e6b10a56ed83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:28.709264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857e0c-f28b-46be-8fbc-e6b10a56ed83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:28.710931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-cb857e0c-f28b-46be-8fbc-e6b10a56ed83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:28.787548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:28.818154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb857e0c-f28b-46be-8fbc-e6b10a56ed83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:28.819643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb857e0c-f28b-46be-8fbc-e6b10a56ed83 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:28.837818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 636/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:31.254800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8347-4ed5-43b3-9108-d462c2933789 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:31.255364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8347-4ed5-43b3-9108-d462c2933789 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:31.255478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8347-4ed5-43b3-9108-d462c2933789 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:31.256806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 696/1332] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:31.262012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081610d9-346b-4874-8732-16a1dfff4799 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:31.262437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081610d9-346b-4874-8732-16a1dfff4799 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:31.262580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081610d9-346b-4874-8732-16a1dfff4799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:31.327008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-081610d9-346b-4874-8732-16a1dfff4799 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:31.328222 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-081610d9-346b-4874-8732-16a1dfff4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:31.422510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 637/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:31.458272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8347-4ed5-43b3-9108-d462c2933789 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:31.459891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fdaf8347-4ed5-43b3-9108-d462c2933789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:31.534171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:31.569000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8347-4ed5-43b3-9108-d462c2933789 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:31.643329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbf39f-9dda-448f-a4fa-448fc5ddd0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:31.643982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf39f-9dda-448f-a4fa-448fc5ddd0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:31.644269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf39f-9dda-448f-a4fa-448fc5ddd0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:31.644548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf39f-9dda-448f-a4fa-448fc5ddd0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:31.646201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ccdbf39f-9dda-448f-a4fa-448fc5ddd0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:31.753632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbf39f-9dda-448f-a4fa-448fc5ddd0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:31.755104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbf39f-9dda-448f-a4fa-448fc5ddd0c6 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:31.764971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:31.773369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 697/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:33.831487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574e85-ad50-438c-9a66-f574c8ae2658 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:33.832050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574e85-ad50-438c-9a66-f574c8ae2658 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:33.832050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574e85-ad50-438c-9a66-f574c8ae2658 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:33.833438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 638/1335] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:33.838587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386b39-312a-402a-ab21-961086a3c234 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:33.839070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386b39-312a-402a-ab21-961086a3c234 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:33.839179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386b39-312a-402a-ab21-961086a3c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:33.903343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9a386b39-312a-402a-ab21-961086a3c234 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:33.904536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9a386b39-312a-402a-ab21-961086a3c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:33.999406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 698/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:34.038765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574e85-ad50-438c-9a66-f574c8ae2658 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:34.040317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4d574e85-ad50-438c-9a66-f574c8ae2658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:34.080745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:34.143871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574e85-ad50-438c-9a66-f574c8ae2658 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:34.214842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d52a78-34b4-40de-b8c7-4b6fd1e54c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:34.215525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52a78-34b4-40de-b8c7-4b6fd1e54c6c service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:34.215810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52a78-34b4-40de-b8c7-4b6fd1e54c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:34.216087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d52a78-34b4-40de-b8c7-4b6fd1e54c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:34.217705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c5d52a78-34b4-40de-b8c7-4b6fd1e54c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:34.301800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:34.327397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d52a78-34b4-40de-b8c7-4b6fd1e54c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:34.329444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d52a78-34b4-40de-b8c7-4b6fd1e54c6c service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:34.346737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 639/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:36.828119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecaea5-e9eb-476f-b0d5-2f6229013d2f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:36.828659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecaea5-e9eb-476f-b0d5-2f6229013d2f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:36.828761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecaea5-e9eb-476f-b0d5-2f6229013d2f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:36.830336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 699/1338] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:36.835584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3a543-13b5-461b-81e8-339323807b87 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:36.835991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3a543-13b5-461b-81e8-339323807b87 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:36.836157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3a543-13b5-461b-81e8-339323807b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:36.899339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-27f3a543-13b5-461b-81e8-339323807b87 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:36.900541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-27f3a543-13b5-461b-81e8-339323807b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:36.995010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 640/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:37.030322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecaea5-e9eb-476f-b0d5-2f6229013d2f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:37.031913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d6ecaea5-e9eb-476f-b0d5-2f6229013d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:37.104882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:37.132672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecaea5-e9eb-476f-b0d5-2f6229013d2f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:37.204883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65538-b0b5-499b-ae21-59478377bba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:37.205840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65538-b0b5-499b-ae21-59478377bba2 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:37.206135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65538-b0b5-499b-ae21-59478377bba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:37.206764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65538-b0b5-499b-ae21-59478377bba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:37.208452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6db65538-b0b5-499b-ae21-59478377bba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:37.316221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65538-b0b5-499b-ae21-59478377bba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:37.317584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65538-b0b5-499b-ae21-59478377bba2 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:37.335160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 700/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:41.345558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc245400-07e0-4f1e-95b1-202a051c9fa3 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:41.346052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc245400-07e0-4f1e-95b1-202a051c9fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:41.346052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc245400-07e0-4f1e-95b1-202a051c9fa3 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:41.347528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 641/1341] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:41.352736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22684f26-8d12-4464-93b2-720ac21ce228 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:41.353172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22684f26-8d12-4464-93b2-720ac21ce228 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:41.353303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22684f26-8d12-4464-93b2-720ac21ce228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:41.360082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:41.427321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-22684f26-8d12-4464-93b2-720ac21ce228 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:41.428585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-22684f26-8d12-4464-93b2-720ac21ce228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:41.538163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 701/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:41.575839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc245400-07e0-4f1e-95b1-202a051c9fa3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:41.578526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-cc245400-07e0-4f1e-95b1-202a051c9fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:41.628006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:41.674181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc245400-07e0-4f1e-95b1-202a051c9fa3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:41.677702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de9c2b-4d9b-4d0b-b9cf-69c1cc51f2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:41.678356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de9c2b-4d9b-4d0b-b9cf-69c1cc51f2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:41.678642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de9c2b-4d9b-4d0b-b9cf-69c1cc51f2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:41.678950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de9c2b-4d9b-4d0b-b9cf-69c1cc51f2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:41.687969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de9c2b-4d9b-4d0b-b9cf-69c1cc51f2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:41.689414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de9c2b-4d9b-4d0b-b9cf-69c1cc51f2f6 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:41.699015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 642/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:44.316087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da49d3-d247-4e31-90fa-88c4a52111f4 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:44.316609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da49d3-d247-4e31-90fa-88c4a52111f4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:44.316609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da49d3-d247-4e31-90fa-88c4a52111f4 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:44.318130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 702/1344] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:44.323142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82dfbf-1418-41ac-9de8-3d22ef9507b3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:44.323548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82dfbf-1418-41ac-9de8-3d22ef9507b3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:44.323720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82dfbf-1418-41ac-9de8-3d22ef9507b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:44.352619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-fb82dfbf-1418-41ac-9de8-3d22ef9507b3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:44.353811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-fb82dfbf-1418-41ac-9de8-3d22ef9507b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:44.433707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 643/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:44.471872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da49d3-d247-4e31-90fa-88c4a52111f4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:44.483229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da49d3-d247-4e31-90fa-88c4a52111f4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:44.489812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866aa91e-5777-4c5e-a4b6-e3cb64f13923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:44.490808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aa91e-5777-4c5e-a4b6-e3cb64f13923 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:44.491139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aa91e-5777-4c5e-a4b6-e3cb64f13923 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:44.491471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aa91e-5777-4c5e-a4b6-e3cb64f13923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:44.503900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866aa91e-5777-4c5e-a4b6-e3cb64f13923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:44.505810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866aa91e-5777-4c5e-a4b6-e3cb64f13923 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:44.518551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 703/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:38:48.442311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2202-c272-45f8-8f33-6ae1b483c5fa None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:48.442845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2202-c272-45f8-8f33-6ae1b483c5fa None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:48.442962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2202-c272-45f8-8f33-6ae1b483c5fa None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:48.444353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 644/1347] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:48.449745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52000-0acd-47ff-a589-4a18f12bbd8f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:48.450201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52000-0acd-47ff-a589-4a18f12bbd8f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:48.450330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52000-0acd-47ff-a589-4a18f12bbd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:48.467860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-27f52000-0acd-47ff-a589-4a18f12bbd8f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:48.469097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-27f52000-0acd-47ff-a589-4a18f12bbd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:48.476832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 704/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:48.516873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2202-c272-45f8-8f33-6ae1b483c5fa None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:38:48.528581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2202-c272-45f8-8f33-6ae1b483c5fa None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:38:48.532939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025ed0e-163f-4a52-81e2-4d456647334b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:38:48.533592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025ed0e-163f-4a52-81e2-4d456647334b service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:48.533885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025ed0e-163f-4a52-81e2-4d456647334b service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:48.534170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025ed0e-163f-4a52-81e2-4d456647334b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:48.543432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025ed0e-163f-4a52-81e2-4d456647334b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:38:48.544872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025ed0e-163f-4a52-81e2-4d456647334b service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:38:48.555657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 645/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:38:53.624608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91339e22-30e7-4f33-a84a-740bd66f1f8e None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:53.625100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91339e22-30e7-4f33-a84a-740bd66f1f8e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:53.625202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91339e22-30e7-4f33-a84a-740bd66f1f8e None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:53.627079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 705/1350] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:53.639132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f21e5-7241-4a4a-aa97-c5ca6a069316 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:53.639598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f21e5-7241-4a4a-aa97-c5ca6a069316 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:53.639678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f21e5-7241-4a4a-aa97-c5ca6a069316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:53.726828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d59f21e5-7241-4a4a-aa97-c5ca6a069316 None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:53.728307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d59f21e5-7241-4a4a-aa97-c5ca6a069316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:53.756869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:53.816048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 646/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:38:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:38:58.068953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6700f-86f6-4974-ab2d-1e376d328020 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:58.069866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6700f-86f6-4974-ab2d-1e376d328020 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:58.070153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6700f-86f6-4974-ab2d-1e376d328020 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:58.071568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 706/1352] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:58.076650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4830-c549-4b76-8ef4-8813474e2555 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:58.077105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4830-c549-4b76-8ef4-8813474e2555 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:58.077216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4830-c549-4b76-8ef4-8813474e2555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:58.097977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bbdb4830-c549-4b76-8ef4-8813474e2555 None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:58.099203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bbdb4830-c549-4b76-8ef4-8813474e2555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:58.108035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 647/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:38:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:38:58.463142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=72 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:38:59.526762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634374-3fe2-402e-b506-bb05eede98a0 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:59.527422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634374-3fe2-402e-b506-bb05eede98a0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:59.527422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634374-3fe2-402e-b506-bb05eede98a0 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:59.528749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 707/1354] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:38:59.534376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44343f1-3e2c-40a4-94d5-68aa38cb69b1 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:38:59.534832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44343f1-3e2c-40a4-94d5-68aa38cb69b1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:38:59.534977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44343f1-3e2c-40a4-94d5-68aa38cb69b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:38:59.552889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c44343f1-3e2c-40a4-94d5-68aa38cb69b1 None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:38:59.554082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c44343f1-3e2c-40a4-94d5-68aa38cb69b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:38:59.562822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 648/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:38:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:03.207246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c66a-ef10-4457-bde3-c8674e31ff81 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:03.208200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c66a-ef10-4457-bde3-c8674e31ff81 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:03.208737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c66a-ef10-4457-bde3-c8674e31ff81 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:03.210453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 708/1356] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:03.216340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9ade-820d-44eb-bbd5-a7efb0809678 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:03.217207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9ade-820d-44eb-bbd5-a7efb0809678 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:03.217722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9ade-820d-44eb-bbd5-a7efb0809678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:03.237070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-196e9ade-820d-44eb-bbd5-a7efb0809678 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:03.238374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-196e9ade-820d-44eb-bbd5-a7efb0809678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:03.247229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 649/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:03.304757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216619-77d8-4614-a1e8-1057764d414c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:03.305620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216619-77d8-4614-a1e8-1057764d414c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:03.306351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216619-77d8-4614-a1e8-1057764d414c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:03.308246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 709/1358] 10.222.0.43 () {54 vars in 961 bytes} [Mon Jun 20 18:39:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:03.321195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a720-6774-429e-a2be-5357e8eea033 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:03.321958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a720-6774-429e-a2be-5357e8eea033 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:03.322803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30a720-6774-429e-a2be-5357e8eea033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:03.378324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6f30a720-6774-429e-a2be-5357e8eea033 None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:03.380090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6f30a720-6774-429e-a2be-5357e8eea033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:03.470516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 650/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Mon Jun 20 18:39:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:03.478990 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06216619-77d8-4614-a1e8-1057764d414c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:03.494384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06216619-77d8-4614-a1e8-1057764d414c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:03.500399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc7cff-05dc-4bfd-a08c-630913ca5c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:03.501055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7cff-05dc-4bfd-a08c-630913ca5c9a service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:03.501345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7cff-05dc-4bfd-a08c-630913ca5c9a service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:03.501629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc7cff-05dc-4bfd-a08c-630913ca5c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:03.510356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc7cff-05dc-4bfd-a08c-630913ca5c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:03.512012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc7cff-05dc-4bfd-a08c-630913ca5c9a service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:03.522728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 710/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:05.755248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e2bb-552d-464e-8165-f232f781a708 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:05.755816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e2bb-552d-464e-8165-f232f781a708 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:05.755816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e2bb-552d-464e-8165-f232f781a708 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:05.757349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 651/1361] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:05.762267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecfec2-9375-419e-a7eb-09da2ae9415e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:05.762659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecfec2-9375-419e-a7eb-09da2ae9415e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:05.762829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecfec2-9375-419e-a7eb-09da2ae9415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:05.781160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-16ecfec2-9375-419e-a7eb-09da2ae9415e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:05.782621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-16ecfec2-9375-419e-a7eb-09da2ae9415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:05.790410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 711/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:05.833991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e2bb-552d-464e-8165-f232f781a708 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:05.849230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e2bb-552d-464e-8165-f232f781a708 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:05.854824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68541ef-5100-4fcd-9da5-a7715e7ce10f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:05.855497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68541ef-5100-4fcd-9da5-a7715e7ce10f service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:05.855788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68541ef-5100-4fcd-9da5-a7715e7ce10f service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:05.856071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68541ef-5100-4fcd-9da5-a7715e7ce10f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:05.864601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68541ef-5100-4fcd-9da5-a7715e7ce10f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:05.866192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68541ef-5100-4fcd-9da5-a7715e7ce10f service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:05.876412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 652/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:08.214019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601fc2-3648-484b-8094-4c750f04d520 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:08.214525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601fc2-3648-484b-8094-4c750f04d520 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:08.214718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601fc2-3648-484b-8094-4c750f04d520 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:08.216455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 712/1364] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:08.222133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c224d-6678-48f6-bb80-ac7d5d016d79 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:08.227052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c224d-6678-48f6-bb80-ac7d5d016d79 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:08.227624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c224d-6678-48f6-bb80-ac7d5d016d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:08.247624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-cf3c224d-6678-48f6-bb80-ac7d5d016d79 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:08.249786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-cf3c224d-6678-48f6-bb80-ac7d5d016d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:08.258179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 653/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:08.304799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491549-bd0a-4dda-a7b8-6b26c43a2769 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:08.305091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491549-bd0a-4dda-a7b8-6b26c43a2769 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:08.305374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491549-bd0a-4dda-a7b8-6b26c43a2769 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:08.306876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 713/1366] 10.222.0.43 () {54 vars in 961 bytes} [Mon Jun 20 18:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:08.313359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bad9-9c26-4f9b-b599-41a604c2c21a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:08.313658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bad9-9c26-4f9b-b599-41a604c2c21a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:08.313944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bad9-9c26-4f9b-b599-41a604c2c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:08.332599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e781bad9-9c26-4f9b-b599-41a604c2c21a None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:08.333894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e781bad9-9c26-4f9b-b599-41a604c2c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:08.343313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 654/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Mon Jun 20 18:39:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:08.351025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491549-bd0a-4dda-a7b8-6b26c43a2769 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:08.364936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491549-bd0a-4dda-a7b8-6b26c43a2769 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:08.370174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0141-086c-40e9-967b-6b75f3767826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:08.370810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0141-086c-40e9-967b-6b75f3767826 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:08.371737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0141-086c-40e9-967b-6b75f3767826 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:08.372031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0141-086c-40e9-967b-6b75f3767826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:08.380742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0141-086c-40e9-967b-6b75f3767826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:08.382317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0141-086c-40e9-967b-6b75f3767826 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:08.392400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 714/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:10.489432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864e1b7-d8c7-4dc5-8a4d-e0a72c07aa9a None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:10.490502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864e1b7-d8c7-4dc5-8a4d-e0a72c07aa9a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:10.491042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864e1b7-d8c7-4dc5-8a4d-e0a72c07aa9a None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:10.492802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 655/1369] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:10.498882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524207ba-4345-4400-a9d3-5513f0db06e6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:10.499919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524207ba-4345-4400-a9d3-5513f0db06e6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:10.500416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524207ba-4345-4400-a9d3-5513f0db06e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:10.519792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-524207ba-4345-4400-a9d3-5513f0db06e6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:10.521321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-524207ba-4345-4400-a9d3-5513f0db06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:10.530108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 715/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:10.574980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864e1b7-d8c7-4dc5-8a4d-e0a72c07aa9a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:10.589700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864e1b7-d8c7-4dc5-8a4d-e0a72c07aa9a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:10.596103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12311eee-f013-4edd-8597-3632d090a490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:10.596785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12311eee-f013-4edd-8597-3632d090a490 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:10.597077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12311eee-f013-4edd-8597-3632d090a490 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:10.597362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12311eee-f013-4edd-8597-3632d090a490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:10.606132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12311eee-f013-4edd-8597-3632d090a490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:10.607756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12311eee-f013-4edd-8597-3632d090a490 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:10.618557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 656/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:11.233769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773320ce-e099-4e33-841a-ee106107ee40 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:11.234063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773320ce-e099-4e33-841a-ee106107ee40 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:11.234600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773320ce-e099-4e33-841a-ee106107ee40 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:11.236017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 716/1372] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:11.241499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b24d30-4763-4931-8fb2-c6152d9e2fe5 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:11.241877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b24d30-4763-4931-8fb2-c6152d9e2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:11.242237 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b24d30-4763-4931-8fb2-c6152d9e2fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:11.260513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a8b24d30-4763-4931-8fb2-c6152d9e2fe5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:11.261721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a8b24d30-4763-4931-8fb2-c6152d9e2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:11.270406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 657/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:39:11.609727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f5862-3412-4857-ac22-815c6b076b9f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:11.609727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f5862-3412-4857-ac22-815c6b076b9f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:11.609727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f5862-3412-4857-ac22-815c6b076b9f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:11.612648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 717/1374] 10.222.0.43 () {54 vars in 963 bytes} [Mon Jun 20 18:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:11.615744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15be676-b8c8-409d-a3d7-fb24bc0c7b0e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:11.616225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15be676-b8c8-409d-a3d7-fb24bc0c7b0e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:11.616386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15be676-b8c8-409d-a3d7-fb24bc0c7b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:11.625121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:11.669953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e15be676-b8c8-409d-a3d7-fb24bc0c7b0e None None] MFA Rules not processed for user `7d62786b3a2b40a6aea979d7875d410b`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:11.671725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e15be676-b8c8-409d-a3d7-fb24bc0c7b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:11.742842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 658/1375] 10.222.0.43 () {58 vars in 1060 bytes} [Mon Jun 20 18:39:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:11.751867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f5862-3412-4857-ac22-815c6b076b9f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:11.762855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f5862-3412-4857-ac22-815c6b076b9f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:11.766448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c8290-464b-4dca-9074-8f0e73100e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:11.767141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8290-464b-4dca-9074-8f0e73100e77 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:11.767618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8290-464b-4dca-9074-8f0e73100e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:11.767901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8290-464b-4dca-9074-8f0e73100e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:11.777304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c8290-464b-4dca-9074-8f0e73100e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:11.778969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c8290-464b-4dca-9074-8f0e73100e77 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:11.790310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 718/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:12.750193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889f7b0-04f8-46c2-af24-81e8354f422b None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:12.750672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889f7b0-04f8-46c2-af24-81e8354f422b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:12.750672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889f7b0-04f8-46c2-af24-81e8354f422b None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:12.752107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 659/1377] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:12.757285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5b53-ca34-48b5-a46d-3b618486f5ed None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:12.757687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5b53-ca34-48b5-a46d-3b618486f5ed None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:12.757863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5b53-ca34-48b5-a46d-3b618486f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:12.775321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-7b1f5b53-ca34-48b5-a46d-3b618486f5ed None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:12.776505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7b1f5b53-ca34-48b5-a46d-3b618486f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:12.784928 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 719/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:12.828249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889f7b0-04f8-46c2-af24-81e8354f422b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:12.842400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889f7b0-04f8-46c2-af24-81e8354f422b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:12.848337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873ad3a-5375-4b91-9b5c-c7712eb95b54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:12.848984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ad3a-5375-4b91-9b5c-c7712eb95b54 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:12.849277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ad3a-5375-4b91-9b5c-c7712eb95b54 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:12.849565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ad3a-5375-4b91-9b5c-c7712eb95b54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:12.857586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873ad3a-5375-4b91-9b5c-c7712eb95b54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:12.859793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873ad3a-5375-4b91-9b5c-c7712eb95b54 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:12.869082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 660/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:14.927222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e5ae-8827-47b8-abbc-d0a1115fb176 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:14.928249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e5ae-8827-47b8-abbc-d0a1115fb176 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:14.928645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e5ae-8827-47b8-abbc-d0a1115fb176 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:14.930496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 720/1380] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:14.935830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204b32-d6b8-403c-9e65-c78084d27120 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:14.936278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204b32-d6b8-403c-9e65-c78084d27120 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:14.936621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204b32-d6b8-403c-9e65-c78084d27120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:14.954277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7d204b32-d6b8-403c-9e65-c78084d27120 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:14.955640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7d204b32-d6b8-403c-9e65-c78084d27120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:14.963454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 661/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:15.007697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1e5ae-8827-47b8-abbc-d0a1115fb176 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:15.022470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1e5ae-8827-47b8-abbc-d0a1115fb176 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:15.027926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47995927-55d5-4458-82e9-aa4aaa5ad829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:15.028576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47995927-55d5-4458-82e9-aa4aaa5ad829 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:15.028867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47995927-55d5-4458-82e9-aa4aaa5ad829 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:15.029147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47995927-55d5-4458-82e9-aa4aaa5ad829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:15.038195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47995927-55d5-4458-82e9-aa4aaa5ad829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:15.039816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47995927-55d5-4458-82e9-aa4aaa5ad829 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:15.049975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 721/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:17.122528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1c84d-075e-4336-80a4-c7fdbebb4a02 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:17.123106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1c84d-075e-4336-80a4-c7fdbebb4a02 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:17.123203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1c84d-075e-4336-80a4-c7fdbebb4a02 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:17.124734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 662/1383] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:17.129931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03bd3-696e-40f7-846b-2f647ce9853c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:17.130349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03bd3-696e-40f7-846b-2f647ce9853c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:17.130560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03bd3-696e-40f7-846b-2f647ce9853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:17.148467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-39c03bd3-696e-40f7-846b-2f647ce9853c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:17.149664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-39c03bd3-696e-40f7-846b-2f647ce9853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:17.158579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 722/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:17.199871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1c84d-075e-4336-80a4-c7fdbebb4a02 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:17.214225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1c84d-075e-4336-80a4-c7fdbebb4a02 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:17.220399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276ede3-5d62-4dc5-9647-f83978e04205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:17.221110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ede3-5d62-4dc5-9647-f83978e04205 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:17.221408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ede3-5d62-4dc5-9647-f83978e04205 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:17.221696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ede3-5d62-4dc5-9647-f83978e04205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:17.230613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276ede3-5d62-4dc5-9647-f83978e04205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:17.232219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276ede3-5d62-4dc5-9647-f83978e04205 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:17.242654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 663/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:19.330882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735294-0523-4890-b5af-1614c5faad45 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:19.330882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735294-0523-4890-b5af-1614c5faad45 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:19.331555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735294-0523-4890-b5af-1614c5faad45 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:19.332483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 723/1386] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:19.337902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479138dc-7581-47e1-8a4d-9bf54aea3934 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:19.338374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479138dc-7581-47e1-8a4d-9bf54aea3934 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:19.338480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479138dc-7581-47e1-8a4d-9bf54aea3934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:19.356369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-479138dc-7581-47e1-8a4d-9bf54aea3934 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:19.357578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-479138dc-7581-47e1-8a4d-9bf54aea3934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:19.366008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 664/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:19.416628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5735294-0523-4890-b5af-1614c5faad45 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:19.432434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5735294-0523-4890-b5af-1614c5faad45 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:19.438065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacac87-c371-4a27-b63c-9cd40d19e551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:19.438717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacac87-c371-4a27-b63c-9cd40d19e551 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:19.439036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacac87-c371-4a27-b63c-9cd40d19e551 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:19.439325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacac87-c371-4a27-b63c-9cd40d19e551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:19.450171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacac87-c371-4a27-b63c-9cd40d19e551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:19.452430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacac87-c371-4a27-b63c-9cd40d19e551 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:19.464154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 724/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:22.137593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baafd1-f59d-40c3-8cb8-d9916750b5a4 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:22.138125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baafd1-f59d-40c3-8cb8-d9916750b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:22.138219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baafd1-f59d-40c3-8cb8-d9916750b5a4 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:22.139609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 665/1389] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:22.145884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853082-0890-4b0d-bf44-a86c82747f34 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:22.146308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853082-0890-4b0d-bf44-a86c82747f34 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:22.146451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853082-0890-4b0d-bf44-a86c82747f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:22.164885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f6853082-0890-4b0d-bf44-a86c82747f34 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:22.166492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f6853082-0890-4b0d-bf44-a86c82747f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:22.175222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 725/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:22.218522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baafd1-f59d-40c3-8cb8-d9916750b5a4 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:22.232739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baafd1-f59d-40c3-8cb8-d9916750b5a4 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:22.238568 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea62ca-aecd-4d8d-987d-7c07080153a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:22.239242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea62ca-aecd-4d8d-987d-7c07080153a4 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:22.239531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea62ca-aecd-4d8d-987d-7c07080153a4 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:22.239813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea62ca-aecd-4d8d-987d-7c07080153a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:22.248002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea62ca-aecd-4d8d-987d-7c07080153a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:22.250317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea62ca-aecd-4d8d-987d-7c07080153a4 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:22.259934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 666/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:39:24.297406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a501c6c-2cc2-4906-99b4-086f51561427 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:24.297927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a501c6c-2cc2-4906-99b4-086f51561427 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:24.297927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a501c6c-2cc2-4906-99b4-086f51561427 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:24.299304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 726/1392] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:24.304640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72dbc0-f4e6-4ea2-adac-d3f9711c6f7a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:24.305109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72dbc0-f4e6-4ea2-adac-d3f9711c6f7a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:24.305219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72dbc0-f4e6-4ea2-adac-d3f9711c6f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:24.323329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-af72dbc0-f4e6-4ea2-adac-d3f9711c6f7a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:24.324533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-af72dbc0-f4e6-4ea2-adac-d3f9711c6f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:24.333114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 667/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:24.377383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a501c6c-2cc2-4906-99b4-086f51561427 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:24.392344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a501c6c-2cc2-4906-99b4-086f51561427 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:24.403386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa83f7a-7910-4342-b11c-76361614d05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:24.404263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa83f7a-7910-4342-b11c-76361614d05c service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:24.404783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa83f7a-7910-4342-b11c-76361614d05c service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:24.405080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa83f7a-7910-4342-b11c-76361614d05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:24.414814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa83f7a-7910-4342-b11c-76361614d05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:24.416439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa83f7a-7910-4342-b11c-76361614d05c service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:24.426503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 727/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:26.488735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62414b8-7baa-4913-af59-4e8d822168d3 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:26.489366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62414b8-7baa-4913-af59-4e8d822168d3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:26.489366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62414b8-7baa-4913-af59-4e8d822168d3 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:26.490710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 668/1395] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:26.496099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6537a7-3409-4d24-a129-fc7c69299075 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:26.496533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6537a7-3409-4d24-a129-fc7c69299075 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:26.496674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6537a7-3409-4d24-a129-fc7c69299075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:26.514315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9a6537a7-3409-4d24-a129-fc7c69299075 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:26.516053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9a6537a7-3409-4d24-a129-fc7c69299075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:26.523887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 728/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:26.568614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62414b8-7baa-4913-af59-4e8d822168d3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:26.583483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62414b8-7baa-4913-af59-4e8d822168d3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:26.588851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9f43e-1316-462c-b04e-72184c708d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:26.589523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f43e-1316-462c-b04e-72184c708d8c service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:26.589814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f43e-1316-462c-b04e-72184c708d8c service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:26.590095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f43e-1316-462c-b04e-72184c708d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:26.598885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9f43e-1316-462c-b04e-72184c708d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:26.600497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9f43e-1316-462c-b04e-72184c708d8c service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:26.610336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 669/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:27.004771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b9095-7ef5-4511-b88d-77c44ffdb36a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:27.005069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b9095-7ef5-4511-b88d-77c44ffdb36a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:27.005384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b9095-7ef5-4511-b88d-77c44ffdb36a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:27.006806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 729/1398] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:27.012415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be65528-c706-464e-83be-7809d9a64001 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:27.012714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be65528-c706-464e-83be-7809d9a64001 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:27.013000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be65528-c706-464e-83be-7809d9a64001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:27.031432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7be65528-c706-464e-83be-7809d9a64001 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:27.032882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7be65528-c706-464e-83be-7809d9a64001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:27.040739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 670/1399] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:27.097343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61bf77-2b0a-4247-9ef9-95d70c7163c9 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:27.097641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61bf77-2b0a-4247-9ef9-95d70c7163c9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:27.097931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61bf77-2b0a-4247-9ef9-95d70c7163c9 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:27.099357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 730/1400] 10.222.0.43 () {54 vars in 962 bytes} [Mon Jun 20 18:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:27.104376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844e52-2f7f-4108-a309-0e04df3c3dbd None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:27.104675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844e52-2f7f-4108-a309-0e04df3c3dbd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:27.104969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844e52-2f7f-4108-a309-0e04df3c3dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:27.152731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2d844e52-2f7f-4108-a309-0e04df3c3dbd None None] MFA Rules not processed for user `880c7a0632ef44a1ab446d1bb53399fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:27.153920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2d844e52-2f7f-4108-a309-0e04df3c3dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:27.186243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:27.215461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 671/1401] 10.222.0.43 () {58 vars in 1059 bytes} [Mon Jun 20 18:39:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:27.222997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61bf77-2b0a-4247-9ef9-95d70c7163c9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:27.234037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61bf77-2b0a-4247-9ef9-95d70c7163c9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:27.237523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588632-1dbb-41e2-92ce-59b18e4ff867 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880c7a0632ef44a1ab446d1bb53399fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:27.238164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588632-1dbb-41e2-92ce-59b18e4ff867 service glance] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:27.238451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588632-1dbb-41e2-92ce-59b18e4ff867 service glance] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:27.238733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588632-1dbb-41e2-92ce-59b18e4ff867 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:27.247662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588632-1dbb-41e2-92ce-59b18e4ff867 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:27.249691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588632-1dbb-41e2-92ce-59b18e4ff867 service glance] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:27.259209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 731/1402] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:27.957370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c398-746f-4ba8-9657-b3f74c9cdc27 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:27.957865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c398-746f-4ba8-9657-b3f74c9cdc27 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:27.957970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c398-746f-4ba8-9657-b3f74c9cdc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:28.004103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-98c7c398-746f-4ba8-9657-b3f74c9cdc27 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:28.005286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-98c7c398-746f-4ba8-9657-b3f74c9cdc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:28.068381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 672/1403] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:39:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:28.112584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886669fb-440b-48e2-8fd4-b70fd06c898c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:28.113048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886669fb-440b-48e2-8fd4-b70fd06c898c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:28.113322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886669fb-440b-48e2-8fd4-b70fd06c898c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:28.114787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 732/1404] 10.222.0.43 () {54 vars in 942 bytes} [Mon Jun 20 18:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:28.120964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb399-727b-4edf-a3f7-f30b9ec66ddd None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:28.121270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb399-727b-4edf-a3f7-f30b9ec66ddd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:28.121587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb399-727b-4edf-a3f7-f30b9ec66ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:28.169694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-69fdb399-727b-4edf-a3f7-f30b9ec66ddd None None] MFA Rules not processed for user `c42180b5adf242e489ddb24534daeea6`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:28.170845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-69fdb399-727b-4edf-a3f7-f30b9ec66ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:28.240102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 673/1405] 10.222.0.43 () {58 vars in 1039 bytes} [Mon Jun 20 18:39:28 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:28.249833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886669fb-440b-48e2-8fd4-b70fd06c898c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:28.263423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886669fb-440b-48e2-8fd4-b70fd06c898c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:28.269094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35152c-9989-4f9b-9332-d8e3e308d805 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:28.269814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35152c-9989-4f9b-9332-d8e3e308d805 service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:28.270174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35152c-9989-4f9b-9332-d8e3e308d805 service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:28.270529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35152c-9989-4f9b-9332-d8e3e308d805 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:28.278979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35152c-9989-4f9b-9332-d8e3e308d805 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:28.281399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35152c-9989-4f9b-9332-d8e3e308d805 service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:28.290464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 733/1406] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:39:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:39:28.665144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe25d7-721c-408a-ad91-1e97b6c6037e None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:28.665533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe25d7-721c-408a-ad91-1e97b6c6037e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:28.665748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe25d7-721c-408a-ad91-1e97b6c6037e None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:28.667263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 674/1407] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:28.672717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04708-ad9d-4eb9-b79c-e9cc6ac59b82 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:28.673020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04708-ad9d-4eb9-b79c-e9cc6ac59b82 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:28.673311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04708-ad9d-4eb9-b79c-e9cc6ac59b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:28.687284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=67 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:28.708074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-c9b04708-ad9d-4eb9-b79c-e9cc6ac59b82 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:28.709384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c9b04708-ad9d-4eb9-b79c-e9cc6ac59b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:28.719289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 734/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:28.764446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe25d7-721c-408a-ad91-1e97b6c6037e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:28.779053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe25d7-721c-408a-ad91-1e97b6c6037e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:28.787463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3da156-d179-4aae-84c4-c9e0a7e647d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:28.788270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3da156-d179-4aae-84c4-c9e0a7e647d4 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:28.788667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3da156-d179-4aae-84c4-c9e0a7e647d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:28.789050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3da156-d179-4aae-84c4-c9e0a7e647d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:28.798983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3da156-d179-4aae-84c4-c9e0a7e647d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:28.800720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3da156-d179-4aae-84c4-c9e0a7e647d4 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:28.806676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:28.814749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 675/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:39:38.701560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:39:50.309505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56baf5-9b88-4bb4-8920-29290bd6816e None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:50.310132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56baf5-9b88-4bb4-8920-29290bd6816e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:50.310132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56baf5-9b88-4bb4-8920-29290bd6816e None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:50.311451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 735/1410] 10.222.0.43 () {54 vars in 918 bytes} [Mon Jun 20 18:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:50.316509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ddb5-df71-4796-bdca-f956da166cbd None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:50.316949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ddb5-df71-4796-bdca-f956da166cbd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:50.317077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ddb5-df71-4796-bdca-f956da166cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:50.335419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-dfb2ddb5-df71-4796-bdca-f956da166cbd None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:50.336611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dfb2ddb5-df71-4796-bdca-f956da166cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:50.345671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 676/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Jun 20 18:39:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:50.359454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763bbf-e4a0-4c6f-8b16-1aa9a13c2aec None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:50.359750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763bbf-e4a0-4c6f-8b16-1aa9a13c2aec None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:50.360034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763bbf-e4a0-4c6f-8b16-1aa9a13c2aec None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:50.361391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 736/1412] 10.222.0.43 () {54 vars in 918 bytes} [Mon Jun 20 18:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:50.365968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9cd0b-ec54-46f7-8c43-51b519ef69f5 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:50.366263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9cd0b-ec54-46f7-8c43-51b519ef69f5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:50.366546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9cd0b-ec54-46f7-8c43-51b519ef69f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:50.383818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a7a9cd0b-ec54-46f7-8c43-51b519ef69f5 None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:50.384989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a7a9cd0b-ec54-46f7-8c43-51b519ef69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:50.394441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 677/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Jun 20 18:39:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:52.888429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30234-68d2-4b3d-87c8-c1381f82d34a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:52.888924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30234-68d2-4b3d-87c8-c1381f82d34a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:52.889023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af30234-68d2-4b3d-87c8-c1381f82d34a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:52.890363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 737/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:52.895626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf296c9-da81-4b5e-b8f7-bef2e2808461 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:52.896063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf296c9-da81-4b5e-b8f7-bef2e2808461 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:52.896200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf296c9-da81-4b5e-b8f7-bef2e2808461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:52.914248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1cf296c9-da81-4b5e-b8f7-bef2e2808461 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:52.915474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1cf296c9-da81-4b5e-b8f7-bef2e2808461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:52.923887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 678/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:52.965557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30234-68d2-4b3d-87c8-c1381f82d34a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:52.980235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af30234-68d2-4b3d-87c8-c1381f82d34a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:52.986146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce653f8-6bdf-4b27-a1de-e4cf0b96c118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:52.986786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce653f8-6bdf-4b27-a1de-e4cf0b96c118 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:52.987106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce653f8-6bdf-4b27-a1de-e4cf0b96c118 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:52.987393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce653f8-6bdf-4b27-a1de-e4cf0b96c118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:52.995419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce653f8-6bdf-4b27-a1de-e4cf0b96c118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:52.997006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce653f8-6bdf-4b27-a1de-e4cf0b96c118 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:53.006326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 738/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:53.894113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba82de-4165-4efb-bf06-212c93be684a None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:53.894410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba82de-4165-4efb-bf06-212c93be684a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:53.894704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba82de-4165-4efb-bf06-212c93be684a None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:53.896129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 679/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:53.900904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413885a-05b7-4114-8266-b019feb3d497 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:53.901296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413885a-05b7-4114-8266-b019feb3d497 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:53.901479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413885a-05b7-4114-8266-b019feb3d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:53.919517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1413885a-05b7-4114-8266-b019feb3d497 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:53.921196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1413885a-05b7-4114-8266-b019feb3d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:53.929050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 739/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:54.079103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba82de-4165-4efb-bf06-212c93be684a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:54.093785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba82de-4165-4efb-bf06-212c93be684a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:54.099134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3a5e-1a1f-48af-9014-a9547a3f2d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:54.099777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3a5e-1a1f-48af-9014-a9547a3f2d80 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:54.100075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3a5e-1a1f-48af-9014-a9547a3f2d80 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:54.100363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3a5e-1a1f-48af-9014-a9547a3f2d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:54.108362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b3a5e-1a1f-48af-9014-a9547a3f2d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:54.109940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b3a5e-1a1f-48af-9014-a9547a3f2d80 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:54.119366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 680/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:54.989199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78539b-0102-4e21-8b5a-3cd215739b18 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:54.989738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78539b-0102-4e21-8b5a-3cd215739b18 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:54.989844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78539b-0102-4e21-8b5a-3cd215739b18 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:54.991201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 740/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:54.995989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674339c-123b-42b0-a43c-432baccc6088 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:54.996461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674339c-123b-42b0-a43c-432baccc6088 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:54.996568 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674339c-123b-42b0-a43c-432baccc6088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:55.015444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7674339c-123b-42b0-a43c-432baccc6088 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:55.016622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7674339c-123b-42b0-a43c-432baccc6088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:55.024356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 681/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:55.175814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78539b-0102-4e21-8b5a-3cd215739b18 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:55.190381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78539b-0102-4e21-8b5a-3cd215739b18 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:55.195856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc402ef0-a2d7-4eec-ba0c-ed0d991161b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:55.196490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402ef0-a2d7-4eec-ba0c-ed0d991161b9 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:55.196775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402ef0-a2d7-4eec-ba0c-ed0d991161b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:55.197056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402ef0-a2d7-4eec-ba0c-ed0d991161b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:55.205693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc402ef0-a2d7-4eec-ba0c-ed0d991161b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:55.207399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc402ef0-a2d7-4eec-ba0c-ed0d991161b9 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:55.216718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 741/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:39:56.096054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e668e-4fe6-4674-b3f9-12995b3df777 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:56.096539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e668e-4fe6-4674-b3f9-12995b3df777 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:56.096651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e668e-4fe6-4674-b3f9-12995b3df777 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:56.098007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 682/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:56.102903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d90c-c8d3-40c3-b93d-839564fecda2 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:56.103322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d90c-c8d3-40c3-b93d-839564fecda2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:56.103540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d90c-c8d3-40c3-b93d-839564fecda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:56.121584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d6a0d90c-c8d3-40c3-b93d-839564fecda2 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:56.122759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d6a0d90c-c8d3-40c3-b93d-839564fecda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:56.130370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 742/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:56.278165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e668e-4fe6-4674-b3f9-12995b3df777 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:56.294686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e668e-4fe6-4674-b3f9-12995b3df777 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:56.300369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a434d-5504-4b0f-b41f-f81dd8e38c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:56.301012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a434d-5504-4b0f-b41f-f81dd8e38c55 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:56.301297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a434d-5504-4b0f-b41f-f81dd8e38c55 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:56.301576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a434d-5504-4b0f-b41f-f81dd8e38c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:56.309656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a434d-5504-4b0f-b41f-f81dd8e38c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:56.311254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a434d-5504-4b0f-b41f-f81dd8e38c55 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:56.321012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 683/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:57.168195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf17e-24ba-4e1e-aaa6-9ad7036b023a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:57.168762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf17e-24ba-4e1e-aaa6-9ad7036b023a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:57.168762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bf17e-24ba-4e1e-aaa6-9ad7036b023a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:57.170180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 743/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:57.175096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259839a-75fd-467f-9104-9534d7720af1 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:57.175509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259839a-75fd-467f-9104-9534d7720af1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:57.175691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259839a-75fd-467f-9104-9534d7720af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:57.193558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4259839a-75fd-467f-9104-9534d7720af1 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:57.194756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4259839a-75fd-467f-9104-9534d7720af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:57.202973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 684/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:57.360312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf17e-24ba-4e1e-aaa6-9ad7036b023a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:57.375503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bf17e-24ba-4e1e-aaa6-9ad7036b023a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:57.381233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127883c3-bfe2-45c2-a0f0-93aaeb00bf7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:57.381919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127883c3-bfe2-45c2-a0f0-93aaeb00bf7f service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:57.382233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127883c3-bfe2-45c2-a0f0-93aaeb00bf7f service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:57.382541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127883c3-bfe2-45c2-a0f0-93aaeb00bf7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:57.391774 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127883c3-bfe2-45c2-a0f0-93aaeb00bf7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:57.393484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127883c3-bfe2-45c2-a0f0-93aaeb00bf7f service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:57.403417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 744/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:58.228357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b94e-3de0-4d31-8ee1-50ec56559bd7 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:58.228895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b94e-3de0-4d31-8ee1-50ec56559bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:58.228985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b94e-3de0-4d31-8ee1-50ec56559bd7 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:58.230352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 685/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:58.236264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69f08-dc88-4401-b85b-4d0d628678d4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:58.236707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69f08-dc88-4401-b85b-4d0d628678d4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:58.236843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69f08-dc88-4401-b85b-4d0d628678d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:58.254443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-cdc69f08-dc88-4401-b85b-4d0d628678d4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:58.255666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-cdc69f08-dc88-4401-b85b-4d0d628678d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:58.263445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 745/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:58.414017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0b94e-3de0-4d31-8ee1-50ec56559bd7 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:58.428051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0b94e-3de0-4d31-8ee1-50ec56559bd7 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:58.433310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37aa8a-3c01-4c70-8b03-31b6ea48d139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:58.433944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37aa8a-3c01-4c70-8b03-31b6ea48d139 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:58.434228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37aa8a-3c01-4c70-8b03-31b6ea48d139 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:58.434508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37aa8a-3c01-4c70-8b03-31b6ea48d139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:58.442433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37aa8a-3c01-4c70-8b03-31b6ea48d139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:58.444031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37aa8a-3c01-4c70-8b03-31b6ea48d139 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:58.453664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 686/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:39:59.259181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d446-4c07-483c-b1d9-6a74dac6cbfc None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:59.259747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d446-4c07-483c-b1d9-6a74dac6cbfc None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:59.259747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d446-4c07-483c-b1d9-6a74dac6cbfc None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:59.261151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 746/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:39:59.266671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba567-d69b-414e-b473-e0646b0744dc None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:59.267102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba567-d69b-414e-b473-e0646b0744dc None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:59.267293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba567-d69b-414e-b473-e0646b0744dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:59.285631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-f3eba567-d69b-414e-b473-e0646b0744dc None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:39:59.286822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f3eba567-d69b-414e-b473-e0646b0744dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:39:59.294507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 687/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:39:59.445196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d446-4c07-483c-b1d9-6a74dac6cbfc None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:39:59.460045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d446-4c07-483c-b1d9-6a74dac6cbfc None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:39:59.465413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b143-73d4-436d-92b8-0bd05d4abb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:39:59.466056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b143-73d4-436d-92b8-0bd05d4abb03 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:39:59.466350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b143-73d4-436d-92b8-0bd05d4abb03 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:39:59.466635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b143-73d4-436d-92b8-0bd05d4abb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:39:59.475239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b143-73d4-436d-92b8-0bd05d4abb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:39:59.476827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b143-73d4-436d-92b8-0bd05d4abb03 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:39:59.486060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 747/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:00.303105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65bfd-26e4-4e09-8c77-0aa043cc36ee None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:00.303662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65bfd-26e4-4e09-8c77-0aa043cc36ee None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:00.303662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65bfd-26e4-4e09-8c77-0aa043cc36ee None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:00.304983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 688/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:00.309905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a085-6ca9-44bb-a13c-317eefcc0445 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:00.310358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a085-6ca9-44bb-a13c-317eefcc0445 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:00.310486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a085-6ca9-44bb-a13c-317eefcc0445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:00.329767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-83e6a085-6ca9-44bb-a13c-317eefcc0445 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:00.330974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-83e6a085-6ca9-44bb-a13c-317eefcc0445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:00.338609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 748/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:40:00.489083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad65bfd-26e4-4e09-8c77-0aa043cc36ee None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:00.503985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad65bfd-26e4-4e09-8c77-0aa043cc36ee None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:00.509491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1edfc-456c-4cc0-9324-0ff58ebfbd13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:00.510131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1edfc-456c-4cc0-9324-0ff58ebfbd13 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:00.510421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1edfc-456c-4cc0-9324-0ff58ebfbd13 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:00.510707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1edfc-456c-4cc0-9324-0ff58ebfbd13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:00.518736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1edfc-456c-4cc0-9324-0ff58ebfbd13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:00.520344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1edfc-456c-4cc0-9324-0ff58ebfbd13 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:00.529491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 689/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:01.332035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f194b-f073-4970-9d72-177712cea23a None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:01.332605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f194b-f073-4970-9d72-177712cea23a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:01.332605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f194b-f073-4970-9d72-177712cea23a None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:01.333985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 749/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:01.338822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952dc5c-7421-4202-8b5d-f0c23f54d124 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:01.339301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952dc5c-7421-4202-8b5d-f0c23f54d124 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:01.339427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952dc5c-7421-4202-8b5d-f0c23f54d124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:01.357444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a952dc5c-7421-4202-8b5d-f0c23f54d124 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:01.359260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a952dc5c-7421-4202-8b5d-f0c23f54d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:01.366983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 690/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:01.519304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f194b-f073-4970-9d72-177712cea23a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:01.534475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f194b-f073-4970-9d72-177712cea23a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:01.539946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8aca50-0aa7-4ea8-8822-66ff17fe1ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:01.540589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8aca50-0aa7-4ea8-8822-66ff17fe1ebe service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:01.540906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8aca50-0aa7-4ea8-8822-66ff17fe1ebe service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:01.541227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8aca50-0aa7-4ea8-8822-66ff17fe1ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:01.550150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8aca50-0aa7-4ea8-8822-66ff17fe1ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:01.551910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8aca50-0aa7-4ea8-8822-66ff17fe1ebe service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:01.562281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 750/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:03.479142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebde944-24b4-48d6-9703-75e1b6b42301 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:03.479708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebde944-24b4-48d6-9703-75e1b6b42301 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:03.479708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebde944-24b4-48d6-9703-75e1b6b42301 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:03.481091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 691/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:03.486272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcc5f1-6d41-476e-89d3-9f044a365072 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:03.486668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcc5f1-6d41-476e-89d3-9f044a365072 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:03.486843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcc5f1-6d41-476e-89d3-9f044a365072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:03.505083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-eafcc5f1-6d41-476e-89d3-9f044a365072 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:03.506265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-eafcc5f1-6d41-476e-89d3-9f044a365072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:03.513941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 751/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:03.552006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebde944-24b4-48d6-9703-75e1b6b42301 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:03.553659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9ebde944-24b4-48d6-9703-75e1b6b42301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:03.566866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebde944-24b4-48d6-9703-75e1b6b42301 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:03.570345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafb99a-3aae-4a9d-8eea-c4799615346d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:03.571011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb99a-3aae-4a9d-8eea-c4799615346d service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:03.571303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb99a-3aae-4a9d-8eea-c4799615346d service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:03.571586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb99a-3aae-4a9d-8eea-c4799615346d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:03.580803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafb99a-3aae-4a9d-8eea-c4799615346d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:03.582228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafb99a-3aae-4a9d-8eea-c4799615346d service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:03.591388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 692/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:05.751917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7a0ba-0a3b-4715-8045-787a6dd0b9d0 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:05.752414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7a0ba-0a3b-4715-8045-787a6dd0b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:05.752523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7a0ba-0a3b-4715-8045-787a6dd0b9d0 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:05.753870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 752/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:05.759284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8596b2-2568-48e8-bfff-676911bb5093 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:05.759715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8596b2-2568-48e8-bfff-676911bb5093 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:05.759867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8596b2-2568-48e8-bfff-676911bb5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:05.777180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-cf8596b2-2568-48e8-bfff-676911bb5093 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:05.778374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-cf8596b2-2568-48e8-bfff-676911bb5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:05.786945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 693/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:05.824789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7a0ba-0a3b-4715-8045-787a6dd0b9d0 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:05.836112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7a0ba-0a3b-4715-8045-787a6dd0b9d0 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:05.839551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595dedf-612d-4fe3-89f8-5cd7a6ceb3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:05.840191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595dedf-612d-4fe3-89f8-5cd7a6ceb3ee service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:05.840475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595dedf-612d-4fe3-89f8-5cd7a6ceb3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:05.840754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595dedf-612d-4fe3-89f8-5cd7a6ceb3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:05.849423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595dedf-612d-4fe3-89f8-5cd7a6ceb3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:05.850883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595dedf-612d-4fe3-89f8-5cd7a6ceb3ee service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:05.860216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 753/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:08.189927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939410-56e2-43a6-87df-d1bd6bd116fe None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:08.190475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939410-56e2-43a6-87df-d1bd6bd116fe None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:08.190475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939410-56e2-43a6-87df-d1bd6bd116fe None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:08.191899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 694/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:08.197167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4366b-bc48-49b6-b082-9ecd10f6799e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:08.197556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4366b-bc48-49b6-b082-9ecd10f6799e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:08.197767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4366b-bc48-49b6-b082-9ecd10f6799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:08.215552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-02b4366b-bc48-49b6-b082-9ecd10f6799e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:08.216743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-02b4366b-bc48-49b6-b082-9ecd10f6799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:08.225069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 754/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:08.262492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1939410-56e2-43a6-87df-d1bd6bd116fe None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:08.273521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1939410-56e2-43a6-87df-d1bd6bd116fe None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:08.276995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d098b-c310-4cc0-a700-3b5fb8480065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:08.277631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d098b-c310-4cc0-a700-3b5fb8480065 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:08.277921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d098b-c310-4cc0-a700-3b5fb8480065 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:08.278202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d098b-c310-4cc0-a700-3b5fb8480065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:08.288007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d098b-c310-4cc0-a700-3b5fb8480065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:08.289441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d098b-c310-4cc0-a700-3b5fb8480065 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:08.299574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 695/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:40:10.449315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f1da1-5050-4d27-acb3-bc82c618de40 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:10.449861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f1da1-5050-4d27-acb3-bc82c618de40 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:10.449861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f1da1-5050-4d27-acb3-bc82c618de40 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:10.451217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 755/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:10.456908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5120-6ed6-4071-86ee-b32993d74bc7 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:10.457313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5120-6ed6-4071-86ee-b32993d74bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:10.457551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5120-6ed6-4071-86ee-b32993d74bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:10.475486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4b1a5120-6ed6-4071-86ee-b32993d74bc7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:10.476683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4b1a5120-6ed6-4071-86ee-b32993d74bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:10.484505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 696/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:10.523854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f1da1-5050-4d27-acb3-bc82c618de40 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:10.535203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f1da1-5050-4d27-acb3-bc82c618de40 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:10.538854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b77fc5-acc8-4532-a2ad-12285bd53d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:10.539533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b77fc5-acc8-4532-a2ad-12285bd53d1f service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:10.539826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b77fc5-acc8-4532-a2ad-12285bd53d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:10.540111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b77fc5-acc8-4532-a2ad-12285bd53d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:10.551880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b77fc5-acc8-4532-a2ad-12285bd53d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:10.553349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b77fc5-acc8-4532-a2ad-12285bd53d1f service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:10.563223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 756/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:12.693248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed835-46d8-441b-925b-d56fdcba2479 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:12.693784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed835-46d8-441b-925b-d56fdcba2479 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:12.693784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed835-46d8-441b-925b-d56fdcba2479 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:12.695163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 697/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:12.700459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6eb2f-d350-4003-a19f-f8975da02a11 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:12.700907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6eb2f-d350-4003-a19f-f8975da02a11 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:12.701046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6eb2f-d350-4003-a19f-f8975da02a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:12.719111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1ad6eb2f-d350-4003-a19f-f8975da02a11 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:12.720302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1ad6eb2f-d350-4003-a19f-f8975da02a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:12.728032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 757/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:12.765617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed835-46d8-441b-925b-d56fdcba2479 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:12.776096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed835-46d8-441b-925b-d56fdcba2479 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:12.779537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9880-89ab-49f0-a66c-0bce42e15d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:12.780203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9880-89ab-49f0-a66c-0bce42e15d1b service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:12.780492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9880-89ab-49f0-a66c-0bce42e15d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:12.780775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9880-89ab-49f0-a66c-0bce42e15d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:12.789687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9880-89ab-49f0-a66c-0bce42e15d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:12.791122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b9880-89ab-49f0-a66c-0bce42e15d1b service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:12.800773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 698/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:14.864938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1791f-e0e1-4830-ab8a-bbfb651dcfa9 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:14.865535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1791f-e0e1-4830-ab8a-bbfb651dcfa9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:14.865535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1791f-e0e1-4830-ab8a-bbfb651dcfa9 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:14.866977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 758/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:14.872156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae883f-c3b9-4f0c-acec-e886fa79d842 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:14.872580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae883f-c3b9-4f0c-acec-e886fa79d842 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:14.872725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae883f-c3b9-4f0c-acec-e886fa79d842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:14.890305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bbae883f-c3b9-4f0c-acec-e886fa79d842 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:14.891522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bbae883f-c3b9-4f0c-acec-e886fa79d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:14.899186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 699/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:14.939578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1791f-e0e1-4830-ab8a-bbfb651dcfa9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:14.950116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1791f-e0e1-4830-ab8a-bbfb651dcfa9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:14.954124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868c79-53b8-4c64-b4a3-10aeb9b87eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:14.954782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868c79-53b8-4c64-b4a3-10aeb9b87eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:14.955098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868c79-53b8-4c64-b4a3-10aeb9b87eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:14.955380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868c79-53b8-4c64-b4a3-10aeb9b87eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:14.964070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868c79-53b8-4c64-b4a3-10aeb9b87eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:14.965511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868c79-53b8-4c64-b4a3-10aeb9b87eb6 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:14.975521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 759/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:17.047439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d48d9-c3d6-4826-9ade-1fa8f453d1cc None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:17.047986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d48d9-c3d6-4826-9ade-1fa8f453d1cc None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:17.048070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d48d9-c3d6-4826-9ade-1fa8f453d1cc None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:17.049431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 700/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:17.054546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1848ab-662a-4b48-b062-fb38023fd51f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:17.054983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1848ab-662a-4b48-b062-fb38023fd51f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:17.055151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1848ab-662a-4b48-b062-fb38023fd51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:17.072357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-5d1848ab-662a-4b48-b062-fb38023fd51f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:17.073541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5d1848ab-662a-4b48-b062-fb38023fd51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:17.081245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 760/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:17.118891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d48d9-c3d6-4826-9ade-1fa8f453d1cc None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:17.129396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d48d9-c3d6-4826-9ade-1fa8f453d1cc None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:17.132826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d835e3-a3f3-4ab4-9988-b7955e2906b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:17.133459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d835e3-a3f3-4ab4-9988-b7955e2906b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:17.133745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d835e3-a3f3-4ab4-9988-b7955e2906b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:17.134025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d835e3-a3f3-4ab4-9988-b7955e2906b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:17.143062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d835e3-a3f3-4ab4-9988-b7955e2906b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:17.144485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d835e3-a3f3-4ab4-9988-b7955e2906b0 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:17.153597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 701/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:19.185282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296cc6b-8343-4476-b4fd-adf6591ae844 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:19.185827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296cc6b-8343-4476-b4fd-adf6591ae844 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:19.185827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296cc6b-8343-4476-b4fd-adf6591ae844 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:19.187817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 761/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:19.192905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0194d-aad9-4263-bf03-cc65036166c4 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:19.193293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0194d-aad9-4263-bf03-cc65036166c4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:19.193457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0194d-aad9-4263-bf03-cc65036166c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:19.199389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=79 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:40:19.212369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-14f0194d-aad9-4263-bf03-cc65036166c4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:19.213585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-14f0194d-aad9-4263-bf03-cc65036166c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:19.221324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 702/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:19.258379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296cc6b-8343-4476-b4fd-adf6591ae844 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:19.263781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=73 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:40:19.270529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296cc6b-8343-4476-b4fd-adf6591ae844 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:19.273971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3e0ce-0e2a-431e-b660-fba106349fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:19.274633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3e0ce-0e2a-431e-b660-fba106349fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:19.274939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3e0ce-0e2a-431e-b660-fba106349fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:19.275348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3e0ce-0e2a-431e-b660-fba106349fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:19.284323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3e0ce-0e2a-431e-b660-fba106349fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:19.285744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3e0ce-0e2a-431e-b660-fba106349fe9 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:19.294899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 762/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:21.367999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b825c-e9c7-41a7-94f2-cf217cb90b3a None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:21.368559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b825c-e9c7-41a7-94f2-cf217cb90b3a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:21.368559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b825c-e9c7-41a7-94f2-cf217cb90b3a None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:21.369950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 703/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:21.375133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae28403-3930-4d28-82b7-4610927d8915 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:21.375542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae28403-3930-4d28-82b7-4610927d8915 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:21.375700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae28403-3930-4d28-82b7-4610927d8915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:21.392955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0ae28403-3930-4d28-82b7-4610927d8915 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:21.394130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0ae28403-3930-4d28-82b7-4610927d8915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:21.401757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 763/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:21.438544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b825c-e9c7-41a7-94f2-cf217cb90b3a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:21.448983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b825c-e9c7-41a7-94f2-cf217cb90b3a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:21.452511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568e481-f2f0-4526-adfb-719ffff829b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:21.453146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568e481-f2f0-4526-adfb-719ffff829b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:21.453435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568e481-f2f0-4526-adfb-719ffff829b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:21.453719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568e481-f2f0-4526-adfb-719ffff829b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:21.462684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568e481-f2f0-4526-adfb-719ffff829b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:21.464144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568e481-f2f0-4526-adfb-719ffff829b4 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:21.473958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 704/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:23.482546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079fb30-3950-4625-8931-457331000bf9 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:23.483136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079fb30-3950-4625-8931-457331000bf9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:23.483136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079fb30-3950-4625-8931-457331000bf9 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:23.484544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 764/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:23.489779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15d82e-81fd-4867-bec6-4b79ffd0ced3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:23.490160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15d82e-81fd-4867-bec6-4b79ffd0ced3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:23.490346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15d82e-81fd-4867-bec6-4b79ffd0ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:23.507986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7f15d82e-81fd-4867-bec6-4b79ffd0ced3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:23.509169 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7f15d82e-81fd-4867-bec6-4b79ffd0ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:23.517306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 705/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:23.554337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079fb30-3950-4625-8931-457331000bf9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:23.565587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079fb30-3950-4625-8931-457331000bf9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:23.569054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42603-12b7-4d05-8b46-98a64825bfce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:23.569721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42603-12b7-4d05-8b46-98a64825bfce service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:23.570005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42603-12b7-4d05-8b46-98a64825bfce service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:23.570286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42603-12b7-4d05-8b46-98a64825bfce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:23.579707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42603-12b7-4d05-8b46-98a64825bfce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:23.581127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42603-12b7-4d05-8b46-98a64825bfce service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:23.590353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 765/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:33.502931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=11 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:40:33.586197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=14 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:40:43.236820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1078-fca1-426b-ae1e-568cf2bf95c1 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:43.237415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1078-fca1-426b-ae1e-568cf2bf95c1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:43.237415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1078-fca1-426b-ae1e-568cf2bf95c1 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:43.238775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 706/1471] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:40:43.244303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba134-c203-43f6-a80b-b7d96fb87055 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:43.244713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba134-c203-43f6-a80b-b7d96fb87055 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:43.244894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba134-c203-43f6-a80b-b7d96fb87055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:43.262679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-469ba134-c203-43f6-a80b-b7d96fb87055 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:43.264500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-469ba134-c203-43f6-a80b-b7d96fb87055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:43.272206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 766/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:43.318827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62ad1-5422-426a-b11d-aa3536258f18 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:43.319162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62ad1-5422-426a-b11d-aa3536258f18 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:43.319453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62ad1-5422-426a-b11d-aa3536258f18 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:43.320820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 707/1473] 10.222.0.43 () {54 vars in 962 bytes} [Mon Jun 20 18:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:43.325468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d699-e81a-4eb4-90db-8c0e09a692da None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:43.325763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d699-e81a-4eb4-90db-8c0e09a692da None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:43.326048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d699-e81a-4eb4-90db-8c0e09a692da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:43.344103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2699d699-e81a-4eb4-90db-8c0e09a692da None None] MFA Rules not processed for user `880c7a0632ef44a1ab446d1bb53399fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:43.345304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2699d699-e81a-4eb4-90db-8c0e09a692da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:43.351606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 767/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Mon Jun 20 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:43.358824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62ad1-5422-426a-b11d-aa3536258f18 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:43.369170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62ad1-5422-426a-b11d-aa3536258f18 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:43.372653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f446-e82f-4231-9c5a-6b262a5d95b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880c7a0632ef44a1ab446d1bb53399fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:43.373774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f446-e82f-4231-9c5a-6b262a5d95b4 service glance] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:43.374066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f446-e82f-4231-9c5a-6b262a5d95b4 service glance] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:43.374351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f446-e82f-4231-9c5a-6b262a5d95b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:43.383259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f446-e82f-4231-9c5a-6b262a5d95b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:43.384686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f446-e82f-4231-9c5a-6b262a5d95b4 service glance] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:43.394609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 708/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:40:45.476064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4018-16d0-449d-ba01-b7f687062e28 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:45.476638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4018-16d0-449d-ba01-b7f687062e28 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:45.476638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4018-16d0-449d-ba01-b7f687062e28 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:45.478002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 768/1476] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:45.483879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30c88-0e47-4991-a8b4-0f542939f171 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:45.484304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30c88-0e47-4991-a8b4-0f542939f171 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:45.484443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30c88-0e47-4991-a8b4-0f542939f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:45.501812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bec30c88-0e47-4991-a8b4-0f542939f171 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:45.503022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bec30c88-0e47-4991-a8b4-0f542939f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:45.510720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 709/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:45.534222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4018-16d0-449d-ba01-b7f687062e28 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:45.547160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4018-16d0-449d-ba01-b7f687062e28 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:45.551808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce87a9d-f660-49a9-9ff2-458d3dddb729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:45.552468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87a9d-f660-49a9-9ff2-458d3dddb729 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:45.552757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87a9d-f660-49a9-9ff2-458d3dddb729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:45.553037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87a9d-f660-49a9-9ff2-458d3dddb729 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:45.553775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce87a9d-f660-49a9-9ff2-458d3dddb729 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:45.555579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-bce87a9d-f660-49a9-9ff2-458d3dddb729 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:40:45.555579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:40:45.555579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:40:45.556731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce87a9d-f660-49a9-9ff2-458d3dddb729 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:45.575397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 769/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Jun 20 18:40:45 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:40:47.587694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ebb6-f463-437e-855b-648835af1e31 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:47.588262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ebb6-f463-437e-855b-648835af1e31 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:47.588262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ebb6-f463-437e-855b-648835af1e31 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:47.589626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 710/1479] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:47.595405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f37d-d483-4bd8-bd1c-b4d62e1a6edd None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:47.595811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f37d-d483-4bd8-bd1c-b4d62e1a6edd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:47.596103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f37d-d483-4bd8-bd1c-b4d62e1a6edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:47.614300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-73a3f37d-d483-4bd8-bd1c-b4d62e1a6edd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:47.615524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-73a3f37d-d483-4bd8-bd1c-b4d62e1a6edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:47.623295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 770/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:47.665496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ebb6-f463-437e-855b-648835af1e31 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:47.681083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ebb6-f463-437e-855b-648835af1e31 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:47.686353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd01c-cd7c-4d31-a9c0-fc5b8fc30f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:47.687012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd01c-cd7c-4d31-a9c0-fc5b8fc30f59 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:47.687302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd01c-cd7c-4d31-a9c0-fc5b8fc30f59 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:47.687583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd01c-cd7c-4d31-a9c0-fc5b8fc30f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:47.695585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd01c-cd7c-4d31-a9c0-fc5b8fc30f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:47.697183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd01c-cd7c-4d31-a9c0-fc5b8fc30f59 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:47.706785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 711/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:49.872260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253fcb-4cac-43d3-a021-ff9e5563e249 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:49.872805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253fcb-4cac-43d3-a021-ff9e5563e249 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:49.872917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253fcb-4cac-43d3-a021-ff9e5563e249 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:49.874236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 771/1482] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:49.879303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a51e8-afc3-45b0-b4ec-68afbc6d05ec None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:49.879700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a51e8-afc3-45b0-b4ec-68afbc6d05ec None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:49.879873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a51e8-afc3-45b0-b4ec-68afbc6d05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:49.896936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b82a51e8-afc3-45b0-b4ec-68afbc6d05ec None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:49.898108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b82a51e8-afc3-45b0-b4ec-68afbc6d05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:49.906643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 712/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:49.942681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06253fcb-4cac-43d3-a021-ff9e5563e249 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:49.953176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06253fcb-4cac-43d3-a021-ff9e5563e249 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:49.956660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b74b4-8c1c-4a89-bd15-ecb45492b5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:49.957297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b74b4-8c1c-4a89-bd15-ecb45492b5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:49.957584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b74b4-8c1c-4a89-bd15-ecb45492b5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:49.957865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b74b4-8c1c-4a89-bd15-ecb45492b5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:49.966600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b74b4-8c1c-4a89-bd15-ecb45492b5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:49.968497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b74b4-8c1c-4a89-bd15-ecb45492b5b2 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:49.977741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 772/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:52.038526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bbdf-41cb-447d-bd25-a1e3d430e585 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:52.039120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bbdf-41cb-447d-bd25-a1e3d430e585 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:52.039120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bbdf-41cb-447d-bd25-a1e3d430e585 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:52.040511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 713/1485] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:52.045631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46933-a470-438b-b800-fca4d0c7c816 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:52.046049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46933-a470-438b-b800-fca4d0c7c816 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:52.046208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46933-a470-438b-b800-fca4d0c7c816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:52.064395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-81a46933-a470-438b-b800-fca4d0c7c816 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:52.065588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-81a46933-a470-438b-b800-fca4d0c7c816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:52.073578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 773/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:52.111035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689bbdf-41cb-447d-bd25-a1e3d430e585 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:52.121574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689bbdf-41cb-447d-bd25-a1e3d430e585 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:52.125545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c2af1-04e6-4d68-9b46-34bdfdb67e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:52.126174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c2af1-04e6-4d68-9b46-34bdfdb67e85 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:52.126469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c2af1-04e6-4d68-9b46-34bdfdb67e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:52.126751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c2af1-04e6-4d68-9b46-34bdfdb67e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:52.135426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c2af1-04e6-4d68-9b46-34bdfdb67e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:52.136849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c2af1-04e6-4d68-9b46-34bdfdb67e85 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:52.146690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 714/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:54.354516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6d81-8e57-4107-aebe-abe26e44ed1f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:54.355047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6d81-8e57-4107-aebe-abe26e44ed1f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:54.355047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc6d81-8e57-4107-aebe-abe26e44ed1f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:54.356440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 774/1488] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:54.361776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fd9a-9efb-426c-9f16-89713c3929a2 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:54.362216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fd9a-9efb-426c-9f16-89713c3929a2 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:54.362403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fd9a-9efb-426c-9f16-89713c3929a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:54.380478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b5f9fd9a-9efb-426c-9f16-89713c3929a2 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:54.381678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b5f9fd9a-9efb-426c-9f16-89713c3929a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:54.390265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 715/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:54.430961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6d81-8e57-4107-aebe-abe26e44ed1f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:54.441973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc6d81-8e57-4107-aebe-abe26e44ed1f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:54.445478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b875a06-d3e2-48e8-a75c-2323ba09b3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:54.446123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875a06-d3e2-48e8-a75c-2323ba09b3ff service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:54.446410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875a06-d3e2-48e8-a75c-2323ba09b3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:54.446693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b875a06-d3e2-48e8-a75c-2323ba09b3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:54.456271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875a06-d3e2-48e8-a75c-2323ba09b3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:54.457702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b875a06-d3e2-48e8-a75c-2323ba09b3ff service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:54.467248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 775/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:40:56.676964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33edf-24cb-45f0-94f2-6431b377bc50 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:56.677502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33edf-24cb-45f0-94f2-6431b377bc50 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:56.677630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33edf-24cb-45f0-94f2-6431b377bc50 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:56.678981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 716/1491] 10.222.0.43 () {54 vars in 926 bytes} [Mon Jun 20 18:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:40:56.685051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd965-51b9-4b80-ac15-b2bf2874d699 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:56.685987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd965-51b9-4b80-ac15-b2bf2874d699 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:56.686117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcd965-51b9-4b80-ac15-b2bf2874d699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:56.704421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-71fcd965-51b9-4b80-ac15-b2bf2874d699 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:40:56.705638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-71fcd965-51b9-4b80-ac15-b2bf2874d699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:40:56.713902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 776/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Jun 20 18:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:40:56.752505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33edf-24cb-45f0-94f2-6431b377bc50 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:40:56.762899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33edf-24cb-45f0-94f2-6431b377bc50 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:40:56.767029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e442a5-c723-417c-859f-90b6a538d2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:40:56.767668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e442a5-c723-417c-859f-90b6a538d2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:40:56.767956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e442a5-c723-417c-859f-90b6a538d2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:40:56.768240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e442a5-c723-417c-859f-90b6a538d2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:40:56.776846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e442a5-c723-417c-859f-90b6a538d2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:40:56.778293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e442a5-c723-417c-859f-90b6a538d2c0 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:40:56.787751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 717/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:41:06.698653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=33 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:41:06.783508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=33 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:42:27.106150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e9bb-c865-41d5-ab23-897fa3827562 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.106740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e9bb-c865-41d5-ab23-897fa3827562 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.106740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e9bb-c865-41d5-ab23-897fa3827562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.125781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-c859e9bb-c865-41d5-ab23-897fa3827562 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:42:27.126992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c859e9bb-c865-41d5-ab23-897fa3827562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:42:27.134566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 777/1494] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:42:27.143646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc785-04eb-4b93-b8f5-9841a402a44c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.144144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc785-04eb-4b93-b8f5-9841a402a44c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.144250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc785-04eb-4b93-b8f5-9841a402a44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.162498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-245cc785-04eb-4b93-b8f5-9841a402a44c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:42:27.163711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-245cc785-04eb-4b93-b8f5-9841a402a44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:42:27.172928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 718/1495] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:42:27.177203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e9bb-c865-41d5-ab23-897fa3827562 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.187250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e9bb-c865-41d5-ab23-897fa3827562 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.191644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.192295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.192580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.192864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.193588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:42:27.193893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.194948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:27.194948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:42:27.194948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:42:27.195830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.207042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 778/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:42:27.214864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc785-04eb-4b93-b8f5-9841a402a44c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.223816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc785-04eb-4b93-b8f5-9841a402a44c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.228324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.228970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.229256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.229537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.230223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.232552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING py.warnings [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:27.232552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: warnings.warn(msg) Jun 20 18:42:27.232552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: Jun 20 18:42:27.233738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.269529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 719/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:42:27 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:42:27.273778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.284201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968500-54dc-4fa5-b61b-f244e28c54da admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.339358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.340527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.340820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.341103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.341803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.342819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:27.342819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:42:27.342819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:42:27.344048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.363852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 779/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:42:27 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:42:27.367957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.378077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6d0a6-de74-472b-abf9-a8169e193e6f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.382495 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.383192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.383481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.383759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.384484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.385494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING py.warnings [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:27.385494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: warnings.warn(msg) Jun 20 18:42:27.385494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: Jun 20 18:42:27.386399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.399765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 720/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:42:27.404186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.414269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685028-3ccb-4d95-98c9-4de81a71275b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.419418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f407c-83a1-456b-a10f-4f439c9f7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.420071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f407c-83a1-456b-a10f-4f439c9f7a52 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.420356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f407c-83a1-456b-a10f-4f439c9f7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.420662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f407c-83a1-456b-a10f-4f439c9f7a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.421391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f407c-83a1-456b-a10f-4f439c9f7a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.422397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-f29f407c-83a1-456b-a10f-4f439c9f7a52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:27.422397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:42:27.422397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:42:27.423307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f407c-83a1-456b-a10f-4f439c9f7a52 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.436563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 780/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:42:27.440204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.450100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fc20f-6567-4a5c-bb15-14ec42dc6015 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.454610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8dd17-c93e-4ad4-ab6b-9a1e882e73d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.455537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8dd17-c93e-4ad4-ab6b-9a1e882e73d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.455828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8dd17-c93e-4ad4-ab6b-9a1e882e73d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.456111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8dd17-c93e-4ad4-ab6b-9a1e882e73d3 admin admin] PATH_INFO: `/v3/projects/b4b0b9f75ab646b2a05e08b2d898d71c/users/8a7aabe49e324634a87ce4227d7f1640/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.471242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8dd17-c93e-4ad4-ab6b-9a1e882e73d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b0b9f75ab646b2a05e08b2d898d71c, user_id=8a7aabe49e324634a87ce4227d7f1640, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.472275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING py.warnings [None req-15c8dd17-c93e-4ad4-ab6b-9a1e882e73d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:27.472275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: warnings.warn(msg) Jun 20 18:42:27.472275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: Jun 20 18:42:27.474201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8dd17-c93e-4ad4-ab6b-9a1e882e73d3 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.487625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 721/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:42:27 2022] PUT /identity/v3/projects/b4b0b9f75ab646b2a05e08b2d898d71c/users/8a7aabe49e324634a87ce4227d7f1640/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:42:27.498766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589db7d-08c3-42dd-8592-075faa52799e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.499118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589db7d-08c3-42dd-8592-075faa52799e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.499407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589db7d-08c3-42dd-8592-075faa52799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.529799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2589db7d-08c3-42dd-8592-075faa52799e None None] MFA Rules not processed for user `8a7aabe49e324634a87ce4227d7f1640`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:42:27.531041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2589db7d-08c3-42dd-8592-075faa52799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:42:27.594461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 781/1502] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:42:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:42:27.607649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1437876-8643-4514-a78f-55f0c0bb2603 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.607961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1437876-8643-4514-a78f-55f0c0bb2603 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.608245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1437876-8643-4514-a78f-55f0c0bb2603 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.609621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 722/1503] 10.222.0.43 () {54 vars in 963 bytes} [Mon Jun 20 18:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:42:27.614329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd54e-965c-4ccb-8a32-752bb682f6f7 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.614594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd54e-965c-4ccb-8a32-752bb682f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.614882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd54e-965c-4ccb-8a32-752bb682f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.632804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a48bd54e-965c-4ccb-8a32-752bb682f6f7 None None] MFA Rules not processed for user `7d62786b3a2b40a6aea979d7875d410b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:42:27.633994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a48bd54e-965c-4ccb-8a32-752bb682f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:42:27.676955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:42:27.685353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 782/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Mon Jun 20 18:42:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:42:27.692554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1437876-8643-4514-a78f-55f0c0bb2603 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.703527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1437876-8643-4514-a78f-55f0c0bb2603 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.707030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.707667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.707979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.708261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.717041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.718457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.726999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 723/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:42:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:42:27.768260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec5056-c5bc-41c9-bbac-cc099d6cc953 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.768563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec5056-c5bc-41c9-bbac-cc099d6cc953 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.768852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec5056-c5bc-41c9-bbac-cc099d6cc953 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.770165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 783/1506] 10.222.0.43 () {52 vars in 829 bytes} [Mon Jun 20 18:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:42:27.773765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:27.834217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69701957-df10-49d7-9260-1c68e625fc60 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:27.838722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:27.839632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.839922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.840209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] PATH_INFO: `/v3/users/8a7aabe49e324634a87ce4227d7f1640` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.841385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7aabe49e324634a87ce4227d7f1640)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:27.842402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING py.warnings [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:27.842402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: warnings.warn(msg) Jun 20 18:42:27.842402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: Jun 20 18:42:27.843633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:27.907451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7aabe49e324634a87ce4227d7f1640'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:27.920370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7aabe49e324634a87ce4227d7f1640'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:27.929839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7aabe49e324634a87ce4227d7f1640'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:27.930718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7aabe49e324634a87ce4227d7f1640'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:27.931407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7aabe49e324634a87ce4227d7f1640'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:27.948281 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:42:27.958074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 724/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:42:27 2022] DELETE /identity/v3/users/8a7aabe49e324634a87ce4227d7f1640 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:42:27.962479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:27.962777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:27.963105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:27.980085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:42:27.981762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:42:28.039280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 784/1508] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:42:28.048758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:28.050158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:42:28.105666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133313c-a15c-4121-b574-f32803f10405 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:28.109254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96386fb5-4039-445b-8260-20adc24dd67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:28.109902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386fb5-4039-445b-8260-20adc24dd67b service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:28.110193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386fb5-4039-445b-8260-20adc24dd67b service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:28.110477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96386fb5-4039-445b-8260-20adc24dd67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:28.119246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96386fb5-4039-445b-8260-20adc24dd67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:28.120673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96386fb5-4039-445b-8260-20adc24dd67b service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:28.130465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 725/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:42:28.539442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:42:28.540899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:42:28.553711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f12304-1600-4738-a6f2-5945e3bd1f9f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:42:28.559449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:42:28.560481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:42:28.560949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:42:28.561245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] PATH_INFO: `/v3/projects/b4b0b9f75ab646b2a05e08b2d898d71c` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:42:28.562460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b0b9f75ab646b2a05e08b2d898d71c)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:42:28.563602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:42:28.563602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:42:28.563602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:42:28.565107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:42:28.623613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b0b9f75ab646b2a05e08b2d898d71c', 'request_id': 'req-48c2a0ec-7a25-4c8f-8430-164e56762d6d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:28.633116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b0b9f75ab646b2a05e08b2d898d71c', 'request_id': 'req-48c2a0ec-7a25-4c8f-8430-164e56762d6d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:28.640121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b0b9f75ab646b2a05e08b2d898d71c', 'request_id': 'req-48c2a0ec-7a25-4c8f-8430-164e56762d6d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:28.658521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] The token cache is being invalidate because project b4b0b9f75ab646b2a05e08b2d898d71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:42:28.658817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:28.659616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-48c2a0ec-7a25-4c8f-8430-164e56762d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:42:28.661535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 785/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:42:28 2022] DELETE /identity/v3/projects/b4b0b9f75ab646b2a05e08b2d898d71c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:42:38.126358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:42:38.655548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:04.782844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7e2e8-4354-4593-a0f0-2d3112a1f5c6 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:04.783443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7e2e8-4354-4593-a0f0-2d3112a1f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:04.783443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7e2e8-4354-4593-a0f0-2d3112a1f5c6 None None] PATH_INFO: `/v3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:04.784787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 726/1511] 10.222.0.48 () {54 vars in 925 bytes} [Mon Jun 20 18:44:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:44:04.791005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4afd-8bc3-409b-a230-179883cecb62 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:04.791461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4afd-8bc3-409b-a230-179883cecb62 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:04.791587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4afd-8bc3-409b-a230-179883cecb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:04.811061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1e4b4afd-8bc3-409b-a230-179883cecb62 None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:04.812243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1e4b4afd-8bc3-409b-a230-179883cecb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:04.876520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 786/1512] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jun 20 18:44:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:05.932963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34afc5-dbfd-4aef-87fb-695d3f3c00ea None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:05.933542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34afc5-dbfd-4aef-87fb-695d3f3c00ea None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:05.933542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34afc5-dbfd-4aef-87fb-695d3f3c00ea None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:05.934960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 727/1513] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:05.939718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37a88-74a9-4f0f-8ecf-26a2b62948f8 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:05.940164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37a88-74a9-4f0f-8ecf-26a2b62948f8 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:05.940275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37a88-74a9-4f0f-8ecf-26a2b62948f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:05.958042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3ad37a88-74a9-4f0f-8ecf-26a2b62948f8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:05.959268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3ad37a88-74a9-4f0f-8ecf-26a2b62948f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:06.019086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 787/1514] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:06.170694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34afc5-dbfd-4aef-87fb-695d3f3c00ea None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:06.172411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1f34afc5-dbfd-4aef-87fb-695d3f3c00ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:06.246606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34afc5-dbfd-4aef-87fb-695d3f3c00ea None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:06.252030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ac82a-bca2-4bc2-a633-8f4e525ad904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:06.252680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ac82a-bca2-4bc2-a633-8f4e525ad904 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:06.252973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ac82a-bca2-4bc2-a633-8f4e525ad904 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:06.253255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ac82a-bca2-4bc2-a633-8f4e525ad904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:06.261105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ac82a-bca2-4bc2-a633-8f4e525ad904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:06.262746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ac82a-bca2-4bc2-a633-8f4e525ad904 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:06.271936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 728/1515] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:44:07.095457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434a47-091d-45e5-8709-57b9f39fa394 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:07.096013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434a47-091d-45e5-8709-57b9f39fa394 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:07.096013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434a47-091d-45e5-8709-57b9f39fa394 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:07.097421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 788/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:07.102153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac68-3b71-4d8c-b579-53a41e620b48 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:07.102550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac68-3b71-4d8c-b579-53a41e620b48 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:07.102724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac68-3b71-4d8c-b579-53a41e620b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:07.121800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ae7fac68-3b71-4d8c-b579-53a41e620b48 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:07.123031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ae7fac68-3b71-4d8c-b579-53a41e620b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:07.130693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 729/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:07.280068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434a47-091d-45e5-8709-57b9f39fa394 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:07.294794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434a47-091d-45e5-8709-57b9f39fa394 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:07.300109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecd692-7789-4344-b201-341abcf99419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:07.300749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd692-7789-4344-b201-341abcf99419 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:07.301039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd692-7789-4344-b201-341abcf99419 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:07.301321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd692-7789-4344-b201-341abcf99419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:07.309900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecd692-7789-4344-b201-341abcf99419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:07.311529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecd692-7789-4344-b201-341abcf99419 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:07.320712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 789/1518] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:44:11.847086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1f065-4171-4a72-afc1-3f2c58a727eb None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:11.847595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1f065-4171-4a72-afc1-3f2c58a727eb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:11.847595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1f065-4171-4a72-afc1-3f2c58a727eb None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:11.849055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 730/1519] 10.222.0.43 () {54 vars in 960 bytes} [Mon Jun 20 18:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:11.853852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a12de-96b8-4c1c-963e-d012c181ffa2 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:11.854247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a12de-96b8-4c1c-963e-d012c181ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:11.854418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a12de-96b8-4c1c-963e-d012c181ffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:11.872360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-c84a12de-96b8-4c1c-963e-d012c181ffa2 None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:11.873536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c84a12de-96b8-4c1c-963e-d012c181ffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:11.881777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 790/1520] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Jun 20 18:44:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:11.889541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1f065-4171-4a72-afc1-3f2c58a727eb None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:11.902601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1f065-4171-4a72-afc1-3f2c58a727eb None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:11.907510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda906a-0c8d-4de8-8af1-deba8b573eb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:11.908142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda906a-0c8d-4de8-8af1-deba8b573eb2 service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:11.908432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda906a-0c8d-4de8-8af1-deba8b573eb2 service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:11.908717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda906a-0c8d-4de8-8af1-deba8b573eb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:11.917209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda906a-0c8d-4de8-8af1-deba8b573eb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:11.918827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda906a-0c8d-4de8-8af1-deba8b573eb2 service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:11.928453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 731/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:44:18.538164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f72f-f388-473f-a7ae-f34e6392b770 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:18.538743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f72f-f388-473f-a7ae-f34e6392b770 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:18.538743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f72f-f388-473f-a7ae-f34e6392b770 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:18.540136 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 791/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:18.545439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca41eab-72ef-4afb-b392-cffeeb673ac0 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:18.545863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca41eab-72ef-4afb-b392-cffeeb673ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:18.546007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca41eab-72ef-4afb-b392-cffeeb673ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:18.566336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4ca41eab-72ef-4afb-b392-cffeeb673ac0 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:18.567552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4ca41eab-72ef-4afb-b392-cffeeb673ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:18.575188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 732/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:18.727055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f72f-f388-473f-a7ae-f34e6392b770 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:18.741207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f72f-f388-473f-a7ae-f34e6392b770 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:18.746978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cc9fd-612e-428f-a11d-8fa338994879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:18.747616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc9fd-612e-428f-a11d-8fa338994879 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:18.747904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc9fd-612e-428f-a11d-8fa338994879 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:18.748186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cc9fd-612e-428f-a11d-8fa338994879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:18.756163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cc9fd-612e-428f-a11d-8fa338994879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:18.757739 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cc9fd-612e-428f-a11d-8fa338994879 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:18.767736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 792/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:44:19.574858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c23d-eb87-407c-908c-f2a7c250a639 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:19.575462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c23d-eb87-407c-908c-f2a7c250a639 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:19.575462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c23d-eb87-407c-908c-f2a7c250a639 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:19.576822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 733/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 18:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:19.581680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34d0f-f85c-4500-bade-aa4614c973e3 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:19.582101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34d0f-f85c-4500-bade-aa4614c973e3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:19.582242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34d0f-f85c-4500-bade-aa4614c973e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:19.599839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ced34d0f-f85c-4500-bade-aa4614c973e3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:19.601036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ced34d0f-f85c-4500-bade-aa4614c973e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:19.609151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 793/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 18:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:19.758740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c23d-eb87-407c-908c-f2a7c250a639 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:19.772938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415c23d-eb87-407c-908c-f2a7c250a639 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:19.778737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a999f-8b0d-4f4b-8bd6-74a0cab6e10f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:19.779404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a999f-8b0d-4f4b-8bd6-74a0cab6e10f service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:19.779693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a999f-8b0d-4f4b-8bd6-74a0cab6e10f service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:19.779974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a999f-8b0d-4f4b-8bd6-74a0cab6e10f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:19.788222 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a999f-8b0d-4f4b-8bd6-74a0cab6e10f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:19.789808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a999f-8b0d-4f4b-8bd6-74a0cab6e10f service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:19.799449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 734/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:44:23.796406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7251c-48df-46e0-9dfd-4bd988ce3c03 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:23.796980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7251c-48df-46e0-9dfd-4bd988ce3c03 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:23.796980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7251c-48df-46e0-9dfd-4bd988ce3c03 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:23.798369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 794/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:23.803821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989e0e-151c-49a7-aad8-b9bb4465779e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:23.804273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989e0e-151c-49a7-aad8-b9bb4465779e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:23.804383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989e0e-151c-49a7-aad8-b9bb4465779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:23.822411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a1989e0e-151c-49a7-aad8-b9bb4465779e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:23.823647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a1989e0e-151c-49a7-aad8-b9bb4465779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:23.832073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 735/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:23.868567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7251c-48df-46e0-9dfd-4bd988ce3c03 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:23.870274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d4a7251c-48df-46e0-9dfd-4bd988ce3c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:23.927242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7251c-48df-46e0-9dfd-4bd988ce3c03 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:23.930751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a16b9-392a-44ed-b8ab-0c5528d318bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:23.931428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a16b9-392a-44ed-b8ab-0c5528d318bc service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:23.931727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a16b9-392a-44ed-b8ab-0c5528d318bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:23.932011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a16b9-392a-44ed-b8ab-0c5528d318bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:23.941261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a16b9-392a-44ed-b8ab-0c5528d318bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:23.942701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a16b9-392a-44ed-b8ab-0c5528d318bc service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:23.947609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:23.953583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 795/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:44:25.935803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8d44-c5cf-4111-90a2-140a6ab067b5 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:25.936364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8d44-c5cf-4111-90a2-140a6ab067b5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:25.936364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8d44-c5cf-4111-90a2-140a6ab067b5 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:25.937749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 736/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:25.943087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d31db-93b1-42c4-bb32-672cfa61cf80 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:25.943523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d31db-93b1-42c4-bb32-672cfa61cf80 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:25.943642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d31db-93b1-42c4-bb32-672cfa61cf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:25.961285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3b3d31db-93b1-42c4-bb32-672cfa61cf80 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:25.962511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3b3d31db-93b1-42c4-bb32-672cfa61cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:25.970215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 796/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:26.005738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb8d44-c5cf-4111-90a2-140a6ab067b5 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:26.016471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb8d44-c5cf-4111-90a2-140a6ab067b5 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:26.019938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4079cf-2c59-46a8-912c-96f235561fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:26.020577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4079cf-2c59-46a8-912c-96f235561fbb service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:26.020866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4079cf-2c59-46a8-912c-96f235561fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:26.021151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4079cf-2c59-46a8-912c-96f235561fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:26.029872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4079cf-2c59-46a8-912c-96f235561fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:26.031327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4079cf-2c59-46a8-912c-96f235561fbb service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:26.040805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 737/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:44:29.509791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd689e5-6d60-4ce2-b49b-76b7ec6e26ca None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:29.510710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd689e5-6d60-4ce2-b49b-76b7ec6e26ca None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:29.511082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd689e5-6d60-4ce2-b49b-76b7ec6e26ca None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:29.512665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 797/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:29.517931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e00a9-ad73-4b6c-957b-78984da3e579 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:29.518318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e00a9-ad73-4b6c-957b-78984da3e579 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:29.518507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e00a9-ad73-4b6c-957b-78984da3e579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:29.524792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=62 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:29.537347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-8d7e00a9-ad73-4b6c-957b-78984da3e579 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:29.538543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8d7e00a9-ad73-4b6c-957b-78984da3e579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:29.546743 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 738/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:29.853283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd689e5-6d60-4ce2-b49b-76b7ec6e26ca None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:29.854999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bfd689e5-6d60-4ce2-b49b-76b7ec6e26ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:29.912251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd689e5-6d60-4ce2-b49b-76b7ec6e26ca None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:29.915900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bfd0c-4c28-4df9-9c06-633efdb53369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:29.916565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfd0c-4c28-4df9-9c06-633efdb53369 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:29.916866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfd0c-4c28-4df9-9c06-633efdb53369 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:29.917154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfd0c-4c28-4df9-9c06-633efdb53369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:29.926784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bfd0c-4c28-4df9-9c06-633efdb53369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:29.928301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bfd0c-4c28-4df9-9c06-633efdb53369 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:29.937672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 798/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:44:32.020540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136450-da83-4a91-8f1c-90ce7f11b351 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:32.021104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136450-da83-4a91-8f1c-90ce7f11b351 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:32.021202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136450-da83-4a91-8f1c-90ce7f11b351 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:32.022534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 739/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 18:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:44:32.027654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ad6e-a090-4dbb-8be9-df1ac229d478 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:32.028643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ad6e-a090-4dbb-8be9-df1ac229d478 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:32.028780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ad6e-a090-4dbb-8be9-df1ac229d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:32.047882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8a12ad6e-a090-4dbb-8be9-df1ac229d478 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:44:32.049092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8a12ad6e-a090-4dbb-8be9-df1ac229d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:32.056829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 799/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 18:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:44:32.361225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136450-da83-4a91-8f1c-90ce7f11b351 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:44:32.362947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2d136450-da83-4a91-8f1c-90ce7f11b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:44:32.376057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136450-da83-4a91-8f1c-90ce7f11b351 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:44:32.379474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f4f0b-8570-4af0-9012-853619d2bd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:44:32.380117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4f0b-8570-4af0-9012-853619d2bd22 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:44:32.380402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4f0b-8570-4af0-9012-853619d2bd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:44:32.380684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4f0b-8570-4af0-9012-853619d2bd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:44:32.390308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f4f0b-8570-4af0-9012-853619d2bd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:44:32.391776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f4f0b-8570-4af0-9012-853619d2bd22 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:44:32.401264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 740/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:44:42.042170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=32 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:44:42.397128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=8 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:45:57.765070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69918d-9c8e-433d-a486-f45c33f22722 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.765733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69918d-9c8e-433d-a486-f45c33f22722 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.765733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69918d-9c8e-433d-a486-f45c33f22722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.773911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d53db-c6bd-4563-b40b-e5d07a4bd84f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.775297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d53db-c6bd-4563-b40b-e5d07a4bd84f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.775297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d53db-c6bd-4563-b40b-e5d07a4bd84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.795942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4f69918d-9c8e-433d-a486-f45c33f22722 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:57.797493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4f69918d-9c8e-433d-a486-f45c33f22722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:57.804354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-957d53db-c6bd-4563-b40b-e5d07a4bd84f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:57.805602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-957d53db-c6bd-4563-b40b-e5d07a4bd84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:57.812833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 800/1540] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:57.822176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 741/1541] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:57.823920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebd853-3374-43b0-b703-51a604b510b0 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.824392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebd853-3374-43b0-b703-51a604b510b0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.824827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebd853-3374-43b0-b703-51a604b510b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.839648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b0ec-a69e-446f-885b-3af61153f134 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.839975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b0ec-a69e-446f-885b-3af61153f134 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.840416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b0ec-a69e-446f-885b-3af61153f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.856485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-76ebd853-3374-43b0-b703-51a604b510b0 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:57.857945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-76ebd853-3374-43b0-b703-51a604b510b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:57.872591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-9bb5b0ec-a69e-446f-885b-3af61153f134 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:57.874058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9bb5b0ec-a69e-446f-885b-3af61153f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:57.875345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 801/1542] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:45:57.880560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebd853-3374-43b0-b703-51a604b510b0 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:57.886703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 742/1543] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:45:57.894945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebd853-3374-43b0-b703-51a604b510b0 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:57.895148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5b0ec-a69e-446f-885b-3af61153f134 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:57.905051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5b0ec-a69e-446f-885b-3af61153f134 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:57.905881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:57.906765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.907244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.907696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.908616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:57.909128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:57.910973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:57.920370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:57.921796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.921796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.922045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.922770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:57.923120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:57.924331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING py.warnings [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:45:57.924331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: warnings.warn(msg) Jun 20 18:45:57.924331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: Jun 20 18:45:57.925984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:57.927334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 802/1544] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:45:57.935481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:57.951059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 743/1545] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:45:57.953511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1419a9-2c37-4e6c-bd63-e34fa6d0fa46 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:57.962938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:57.970628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a0c4-8a9b-43b7-b4c8-ba7fff879fed admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:57.971745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:57.972655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.973098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.973542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.974417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:57.975645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:45:57.975645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:45:57.975645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:45:57.977181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:57.983159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:57.983864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:57.984156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:57.984444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:57.985161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:57.987681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.036192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 803/1546] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:57 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:45:58.041159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.049186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 744/1547] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:57 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:45:58.063563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.124981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4db76b-a0bc-4aac-a5eb-d8f86adda1f1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.194616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.195649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.196122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.196619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.197511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.200166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.201097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0071c9b-631b-48d0-91d0-b69d5305cec0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.210757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.211564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.211784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.212069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.212780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.213892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING py.warnings [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:45:58.213892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: warnings.warn(msg) Jun 20 18:45:58.213892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: Jun 20 18:45:58.215101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.227856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 804/1548] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:45:58.233124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.252098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b00c-96dc-400c-98f4-0ba7cece288f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.262493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.264259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.264553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.264837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.267127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.270167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 745/1549] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:45:58.270858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.279501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.299025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 805/1550] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:58.300603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1adcb-1a7e-4f62-a65f-9cf17c89bc1a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.302356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.305964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d45ab4-7076-4193-8901-6d8be0cb46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.306711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45ab4-7076-4193-8901-6d8be0cb46e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.307076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45ab4-7076-4193-8901-6d8be0cb46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.307363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45ab4-7076-4193-8901-6d8be0cb46e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.308455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d45ab4-7076-4193-8901-6d8be0cb46e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.310438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d45ab4-7076-4193-8901-6d8be0cb46e3 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.329467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e56b0-526c-44aa-83de-87bcefc2023b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.331524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 746/1551] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:45:58.335216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b8e53-6c0d-41f9-b2d6-c7707e5fa341 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.335512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b8e53-6c0d-41f9-b2d6-c7707e5fa341 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.335801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b8e53-6c0d-41f9-b2d6-c7707e5fa341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.345323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.345884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.346177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.351188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.352047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.355217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.366329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ff1b8e53-6c0d-41f9-b2d6-c7707e5fa341 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.367980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ff1b8e53-6c0d-41f9-b2d6-c7707e5fa341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.374939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 806/1552] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:45:58.374939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.385574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946e72-059e-469a-901f-82f164432586 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.389200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 747/1553] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:45:58.390532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b8e53-6c0d-41f9-b2d6-c7707e5fa341 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.403095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025109-2e53-4e92-a55d-2aafd800846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.403095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025109-2e53-4e92-a55d-2aafd800846d admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.403095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025109-2e53-4e92-a55d-2aafd800846d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.403095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025109-2e53-4e92-a55d-2aafd800846d admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.403641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025109-2e53-4e92-a55d-2aafd800846d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.403641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96025109-2e53-4e92-a55d-2aafd800846d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.414019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 807/1554] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:58.418511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed572e-1196-4766-9d23-78f649127bd3 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.419152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed572e-1196-4766-9d23-78f649127bd3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.419452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed572e-1196-4766-9d23-78f649127bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.421721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b8e53-6c0d-41f9-b2d6-c7707e5fa341 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.430493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809754c3-1e30-4745-948e-4052aa8b86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.431639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809754c3-1e30-4745-948e-4052aa8b86fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.431936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809754c3-1e30-4745-948e-4052aa8b86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.432221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809754c3-1e30-4745-948e-4052aa8b86fa admin admin] PATH_INFO: `/v3/projects/e724578c7aab45bb8ae2317c33e3be33/users/016cfd43630b42f38efcd37ea9a66a10/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.440898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e7ed572e-1196-4766-9d23-78f649127bd3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.442123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e7ed572e-1196-4766-9d23-78f649127bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.448902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809754c3-1e30-4745-948e-4052aa8b86fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e724578c7aab45bb8ae2317c33e3be33, user_id=016cfd43630b42f38efcd37ea9a66a10, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.451064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 808/1555] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.452349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02cd8-0bb2-4aa1-9d6b-5925fcdcf00a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.452641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02cd8-0bb2-4aa1-9d6b-5925fcdcf00a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.452925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02cd8-0bb2-4aa1-9d6b-5925fcdcf00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.453126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809754c3-1e30-4745-948e-4052aa8b86fa admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.474346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ece02cd8-0bb2-4aa1-9d6b-5925fcdcf00a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.475572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ece02cd8-0bb2-4aa1-9d6b-5925fcdcf00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.480770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:45:58.484130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 748/1556] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:45:58 2022] PUT /identity/v3/projects/e724578c7aab45bb8ae2317c33e3be33/users/016cfd43630b42f38efcd37ea9a66a10/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:45:58.485810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85809c7-3b73-420d-890b-7500627e226b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.486997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85809c7-3b73-420d-890b-7500627e226b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.489192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85809c7-3b73-420d-890b-7500627e226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.512801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c85809c7-3b73-420d-890b-7500627e226b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.515036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c85809c7-3b73-420d-890b-7500627e226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.558528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 809/1557] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.559469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02cd8-0bb2-4aa1-9d6b-5925fcdcf00a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.569143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02cd8-0bb2-4aa1-9d6b-5925fcdcf00a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.573975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41322012-a746-47ad-b51a-f8649c23c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.574864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322012-a746-47ad-b51a-f8649c23c903 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.575193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322012-a746-47ad-b51a-f8649c23c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.575463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41322012-a746-47ad-b51a-f8649c23c903 admin admin] PATH_INFO: `/v3/projects/b4944c36091d4f5f84e06386ee5a1589/users/60a36e18710443359ba2a56ad2810043/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.579718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:45:58.589198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 749/1558] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.589922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41322012-a746-47ad-b51a-f8649c23c903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4944c36091d4f5f84e06386ee5a1589, user_id=60a36e18710443359ba2a56ad2810043, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.591009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-41322012-a746-47ad-b51a-f8649c23c903 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:45:58.591009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:45:58.591009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:45:58.592694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f08a4-86c5-4b5f-8b0e-ed4edef879f4 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.592823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f08a4-86c5-4b5f-8b0e-ed4edef879f4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.592983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41322012-a746-47ad-b51a-f8649c23c903 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.593097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f08a4-86c5-4b5f-8b0e-ed4edef879f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.605538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 810/1559] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:45:58 2022] PUT /identity/v3/projects/b4944c36091d4f5f84e06386ee5a1589/users/60a36e18710443359ba2a56ad2810043/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:45:58.606810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d6d39-7a29-4621-a343-c7362196a520 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.607200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d6d39-7a29-4621-a343-c7362196a520 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.607528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d6d39-7a29-4621-a343-c7362196a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.611287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c49f08a4-86c5-4b5f-8b0e-ed4edef879f4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.613024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c49f08a4-86c5-4b5f-8b0e-ed4edef879f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.624728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-5e2d6d39-7a29-4621-a343-c7362196a520 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.625926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5e2d6d39-7a29-4621-a343-c7362196a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.671181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 750/1560] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.672422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b853-7a56-45c0-8794-7a935026504e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.672722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b853-7a56-45c0-8794-7a935026504e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.673002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b853-7a56-45c0-8794-7a935026504e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.691834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1299b853-7a56-45c0-8794-7a935026504e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.693148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1299b853-7a56-45c0-8794-7a935026504e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.693766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 811/1561] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.699478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cc356-362c-4457-b58a-56e7bc788c3a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.699478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cc356-362c-4457-b58a-56e7bc788c3a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.699478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cc356-362c-4457-b58a-56e7bc788c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.707468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 751/1562] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.708818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa434ed-62e3-4f58-be4f-2053687b3ebd None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.709114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa434ed-62e3-4f58-be4f-2053687b3ebd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.709399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa434ed-62e3-4f58-be4f-2053687b3ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.720455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2a9cc356-362c-4457-b58a-56e7bc788c3a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.722486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2a9cc356-362c-4457-b58a-56e7bc788c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.730371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 812/1563] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.731709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3f30-409b-402b-8ff9-afcd7645cbfb None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.731944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3f30-409b-402b-8ff9-afcd7645cbfb None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.732232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa3f30-409b-402b-8ff9-afcd7645cbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.736074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5fa434ed-62e3-4f58-be4f-2053687b3ebd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.737515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5fa434ed-62e3-4f58-be4f-2053687b3ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.746412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 752/1564] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.747251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa434ed-62e3-4f58-be4f-2053687b3ebd None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.751100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3bfa3f30-409b-402b-8ff9-afcd7645cbfb None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.752481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3bfa3f30-409b-402b-8ff9-afcd7645cbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.756692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa434ed-62e3-4f58-be4f-2053687b3ebd None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.760858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 813/1565] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.761185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4a060-da8e-4fb9-8a9e-a66aebaed135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.761872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4a060-da8e-4fb9-8a9e-a66aebaed135 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.762141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763928-9ec5-4207-93d8-fb3f1d7c7d23 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.762260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4a060-da8e-4fb9-8a9e-a66aebaed135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.762437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4a060-da8e-4fb9-8a9e-a66aebaed135 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.762545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763928-9ec5-4207-93d8-fb3f1d7c7d23 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.762722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763928-9ec5-4207-93d8-fb3f1d7c7d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.763178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4a060-da8e-4fb9-8a9e-a66aebaed135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:58.763490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4a060-da8e-4fb9-8a9e-a66aebaed135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.765294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4a060-da8e-4fb9-8a9e-a66aebaed135 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.777771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 753/1566] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:45:58.779748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.779946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d7763928-9ec5-4207-93d8-fb3f1d7c7d23 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.780383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.780383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.781108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d7763928-9ec5-4207-93d8-fb3f1d7c7d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.789568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 814/1567] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.790459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7763928-9ec5-4207-93d8-fb3f1d7c7d23 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.798880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.800245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7763928-9ec5-4207-93d8-fb3f1d7c7d23 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.800615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.804671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b67ee0-a041-482f-870d-212b6fcf9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.805322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b67ee0-a041-482f-870d-212b6fcf9ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.805609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b67ee0-a041-482f-870d-212b6fcf9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.805890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b67ee0-a041-482f-870d-212b6fcf9ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.806612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b67ee0-a041-482f-870d-212b6fcf9ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:58.806931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b67ee0-a041-482f-870d-212b6fcf9ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.808487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 754/1568] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.808826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b67ee0-a041-482f-870d-212b6fcf9ca9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.809259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.810671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.820690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 815/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:45:58.821979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143969e-fba1-4fb2-ae40-56cdb0b82136 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.822271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143969e-fba1-4fb2-ae40-56cdb0b82136 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.822551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143969e-fba1-4fb2-ae40-56cdb0b82136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.840867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3143969e-fba1-4fb2-ae40-56cdb0b82136 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.842096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3143969e-fba1-4fb2-ae40-56cdb0b82136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.850346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 816/1570] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.851696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf39300-b3eb-4f66-afc2-2bc7631c4def None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.851993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf39300-b3eb-4f66-afc2-2bc7631c4def None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.852269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf39300-b3eb-4f66-afc2-2bc7631c4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.869469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ccf39300-b3eb-4f66-afc2-2bc7631c4def None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:45:58.870689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ccf39300-b3eb-4f66-afc2-2bc7631c4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:45:58.874501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07625c9d-8d69-4f1f-b545-a25b3a12d780 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.878563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.882480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.882613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 817/1571] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:45:58.882725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.882725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.882909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf39300-b3eb-4f66-afc2-2bc7631c4def None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.889322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf39300-b3eb-4f66-afc2-2bc7631c4def None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.890459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.891920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.893896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.894562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.894852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.895158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.895879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:58.896184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.897768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.901620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 755/1572] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:45:58.902248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.917254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 818/1573] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:45:58.917254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.917538 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa71e0-201d-46a3-8608-e36f2a8eac5c service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.922121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.922997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.923291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.924069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.925398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.927798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.928166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848951ea-10c9-4000-8f9c-6423abc87cde admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.932650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:58.933449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:58.933692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:58.933972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:58.944021 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:58.945704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:58.956113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 819/1574] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:45:58.957501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.957620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 756/1575] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:58.958357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:58.969684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670d1bd-2722-4fbe-a70f-ee43440b2ba5 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:58.984031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:45:59.016163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:45:59.031599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70a19-663c-4c69-ae87-b98958ee272f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.038140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.038820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.039265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.039494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.040479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.042435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.049256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.051207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.051509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.051932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.052693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:59.053046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.055195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.068895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 820/1576] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:45:59.069837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.081807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 757/1577] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:58 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.083491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.084219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e80a7-8b18-4635-a9f6-9f4f4f18a70a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.159556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e935-6714-4d94-aef2-81d79fca8d84 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.160081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.160764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.161165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.161462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.162448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:59.162760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.164562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.164799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.165553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.165913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.166273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.167120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:45:59.167650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.169261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.177655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 821/1578] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:45:59.178495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.198532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb0df-5b4f-4f25-9bd2-1c322a72f7e6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.199379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 758/1579] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:45:59.200600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.204539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.205311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.205586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.206178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.206884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.209456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.213083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecb1cd-b510-4c80-b942-8556f075f21c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.217887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.218616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.218889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.219461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.220162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.222632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.244428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 822/1580] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.244428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.252908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 759/1581] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/users => generated 292 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.253842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.264887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c050-963e-40dd-b1ec-4a0283658a9d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.315099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc33e6e-e1b2-4e81-bd2e-56d58bd2c842 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.320882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.321925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.322104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.322399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.323143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.325078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.342152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.343208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.343546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.343916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.344763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.347642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.355293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 823/1582] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.360309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.376927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:45:59.382894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 760/1583] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.382894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.398817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f741c-10f7-4a91-90e1-dc93fd639e6a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.468203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:45:59.485277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7676c-474d-4ea5-8c98-3a04b5776775 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.493642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.494200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.494562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.494812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.495868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.497801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.518458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.519157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.519443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.519728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.520430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.522374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.544019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 824/1584] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.544901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.570180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 761/1585] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.571078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.674026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177d6b2-20fc-4604-a5d3-a1ce5c7bcaea admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.681793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071462-c5ba-4e1b-b007-2459023e3aca admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.686744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.687533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.688202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.688329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.688329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.688754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.689060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.689194 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.689415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.690943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.691524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.693921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.707804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 762/1586] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:59.708962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.725132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886877f-3b1c-47c8-b421-d6fc7070cc80 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.730690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.731861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.733878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.734166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.734941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.736899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.748524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 825/1587] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.749759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.761160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0bf08-6d7d-4330-bd12-bae27d5fb3df admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.766657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 763/1588] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/users => generated 302 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.768348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.771899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.779081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.779516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.779860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.780761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.783472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.785788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0dda-4518-44f8-9252-bc9a14cd6c40 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.793860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.794717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.795158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.795612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.796715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.800484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 826/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:59.800484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.800713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.813683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d5dc0-e8fd-4144-bc83-b0acb4f9a58e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.819396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.820085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.820363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.820649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.821350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.823349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.832172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 764/1590] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/users => generated 285 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.833377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.845132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93a1c3-d1d2-4c7a-8c37-fb5614358d98 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.853175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 827/1591] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:45:59 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:45:59.853175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.854186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.857036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.857338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.858899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.862304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.866536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.876733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf959db7-7d3d-4d04-81e4-cdb65a6f645b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.888312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 765/1592] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:59.889185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.890137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.890826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.891178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.891459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.892473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.895141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.911994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2509e-6efb-44af-9acf-fcc9781b50eb admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.916805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 828/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:59.916805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.927444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.927651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c9bc-e3b3-492f-a255-bb0316b2174c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.929407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.933164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.933838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.934128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.934252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.934529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.934648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.935313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.935528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.936998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.937424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.950565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 766/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:59.950960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 829/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:59.951658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.951872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.964254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc6d0-1c1d-4a05-bb57-5c89d0ccba57 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.969499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.970191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.970481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.970768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.972283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.973869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:45:59.981524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697b3d-4fd1-45b3-8133-42304636cab1 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:45:59.987667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 830/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:45:59.988694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:45:59.994101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:45:59.995408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:45:59.995705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:45:59.996761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:45:59.997580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:45:59.999758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.000618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605390f9-42a0-49dc-8150-516ef6e99e7c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.007224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.008815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.009208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.009646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] PATH_INFO: `/v3/projects/28aec5b111624af3a061ce7fd1a03b32/users/e13f3c0f9456465d8c9ceb206f958373/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.015631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 767/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:00.015631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.031180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17a618-fb96-48f8-bc15-496176104247 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.034613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=28aec5b111624af3a061ce7fd1a03b32, user_id=e13f3c0f9456465d8c9ceb206f958373, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.038134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.038673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.040946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.042152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.042451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.043786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.045671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.050224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:00.064932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 768/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:00.066462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.074120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 831/1599] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:45:59 2022] PUT /identity/v3/projects/28aec5b111624af3a061ce7fd1a03b32/users/e13f3c0f9456465d8c9ceb206f958373/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:00.074991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.079773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b042f-f639-4c3a-9aee-307f5e7f3149 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.158602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:00.182000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.182944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.183324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.183757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.184711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.186597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.203344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 769/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:00.204496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.218223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e79e6-7886-4724-86d9-41c36e521946 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.223436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.224298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.224594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.224963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.226337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.227747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.236372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122760b9-9a4f-4792-848f-88fe8ddd18bf admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.246763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 770/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:00.246763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.248017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cdf3a-b219-40be-a9b5-c3340026d864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.248727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cdf3a-b219-40be-a9b5-c3340026d864 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.248947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cdf3a-b219-40be-a9b5-c3340026d864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.249388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cdf3a-b219-40be-a9b5-c3340026d864 admin admin] PATH_INFO: `/v3/projects/21f1a2549de24c31910eb3cdb809c5e9/users/2ada4576c0084912b41c846d849ce6ee/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.261928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253619e8-9d96-4674-be4e-788881915683 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.270776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.270776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.271431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.271815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.272667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.275487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.287833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cdf3a-b219-40be-a9b5-c3340026d864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f1a2549de24c31910eb3cdb809c5e9, user_id=2ada4576c0084912b41c846d849ce6ee, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.291599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cdf3a-b219-40be-a9b5-c3340026d864 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.291836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 771/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:00.293191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.304659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0c571-c161-43c0-ad83-d2019a1a3605 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.316480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.317994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.330101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 832/1603] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:00 2022] PUT /identity/v3/projects/21f1a2549de24c31910eb3cdb809c5e9/users/2ada4576c0084912b41c846d849ce6ee/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:00.331938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff085-a6e8-49d9-b4eb-1b43dbeaec24 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.332235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff085-a6e8-49d9-b4eb-1b43dbeaec24 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.332520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff085-a6e8-49d9-b4eb-1b43dbeaec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.333815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.334471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] PATH_INFO: `/v3/projects/cea270975d1d49d2b00c9408279bf867/users/fbd58fa54588416ab254e504266cb0a0/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.367896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea270975d1d49d2b00c9408279bf867, user_id=fbd58fa54588416ab254e504266cb0a0, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.371622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.408654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 772/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:00 2022] PUT /identity/v3/projects/cea270975d1d49d2b00c9408279bf867/users/fbd58fa54588416ab254e504266cb0a0/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:00.412037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.415311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-935ff085-a6e8-49d9-b4eb-1b43dbeaec24 None None] MFA Rules not processed for user `e13f3c0f9456465d8c9ceb206f958373`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:00.416783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-935ff085-a6e8-49d9-b4eb-1b43dbeaec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:00.524916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0f31-0fe9-4d77-bed6-e03c9edb190a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.531882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.533271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.534705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.535231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] PATH_INFO: `/v3/projects/fe5a616fa25d4234a30e36bf6278e68f/users/db8a2559379049d099a7724ffc0f7752/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.553649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 833/1605] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:00.556035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ff085-a6e8-49d9-b4eb-1b43dbeaec24 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.571677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5a616fa25d4234a30e36bf6278e68f, user_id=db8a2559379049d099a7724ffc0f7752, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.574792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.576390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ff085-a6e8-49d9-b4eb-1b43dbeaec24 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.588779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847572b-b28e-40ca-ae0a-2f0f1b5b31a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.591691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847572b-b28e-40ca-ae0a-2f0f1b5b31a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.592371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 773/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:00 2022] PUT /identity/v3/projects/fe5a616fa25d4234a30e36bf6278e68f/users/db8a2559379049d099a7724ffc0f7752/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:00.593498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847572b-b28e-40ca-ae0a-2f0f1b5b31a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.593811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847572b-b28e-40ca-ae0a-2f0f1b5b31a2 admin admin] PATH_INFO: `/v3/projects/8006d78bc1604611b3254b5efa451288/users/c3134832f2a647aab761da347f7e9fd4/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.593946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:00.636737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847572b-b28e-40ca-ae0a-2f0f1b5b31a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8006d78bc1604611b3254b5efa451288, user_id=c3134832f2a647aab761da347f7e9fd4, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.645514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847572b-b28e-40ca-ae0a-2f0f1b5b31a2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.670459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 834/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:00 2022] PUT /identity/v3/projects/8006d78bc1604611b3254b5efa451288/users/c3134832f2a647aab761da347f7e9fd4/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:00.671818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053910d-2d2a-4950-8b7a-9086b86b7e04 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.673901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744011-f930-4315-84c2-da319cf43bcf admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:00.674289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053910d-2d2a-4950-8b7a-9086b86b7e04 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.675118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053910d-2d2a-4950-8b7a-9086b86b7e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.694710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:00.719902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0053910d-2d2a-4950-8b7a-9086b86b7e04 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:00.721312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0053910d-2d2a-4950-8b7a-9086b86b7e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:00.786474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602a266-497d-4e56-9ac3-97c08fd589e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:00.791150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602a266-497d-4e56-9ac3-97c08fd589e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.793607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602a266-497d-4e56-9ac3-97c08fd589e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.794659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602a266-497d-4e56-9ac3-97c08fd589e4 admin admin] PATH_INFO: `/v3/projects/16e7a4e87e2749c5a2e86f72363f00f2/users/4645bdadbc8a4951a3237bcd3fd07500/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.813508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:00.830424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602a266-497d-4e56-9ac3-97c08fd589e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e7a4e87e2749c5a2e86f72363f00f2, user_id=4645bdadbc8a4951a3237bcd3fd07500, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:00.834450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602a266-497d-4e56-9ac3-97c08fd589e4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:00.858772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 774/1608] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:00 2022] PUT /identity/v3/projects/16e7a4e87e2749c5a2e86f72363f00f2/users/4645bdadbc8a4951a3237bcd3fd07500/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:00.860868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965771db-24e6-409f-a54a-8c68597bda2c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.862459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965771db-24e6-409f-a54a-8c68597bda2c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.862936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965771db-24e6-409f-a54a-8c68597bda2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.870147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 835/1609] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:00.871557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12a575-61e7-44b9-8587-404ddf6b20c3 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:00.871862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12a575-61e7-44b9-8587-404ddf6b20c3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:00.872137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12a575-61e7-44b9-8587-404ddf6b20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:00.900898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-965771db-24e6-409f-a54a-8c68597bda2c None None] MFA Rules not processed for user `fbd58fa54588416ab254e504266cb0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:00.903258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-965771db-24e6-409f-a54a-8c68597bda2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:00.912452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6e12a575-61e7-44b9-8587-404ddf6b20c3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:00.913676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6e12a575-61e7-44b9-8587-404ddf6b20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:01.008873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 775/1610] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:01.008873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b057-e3e8-48d5-ac75-64f46a02d3c5 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.008873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b057-e3e8-48d5-ac75-64f46a02d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.008873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726b057-e3e8-48d5-ac75-64f46a02d3c5 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.010225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 776/1611] 10.222.0.43 () {54 vars in 961 bytes} [Mon Jun 20 18:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:01.013085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de2c60-4239-4add-80b7-ba399d17378d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.015038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de2c60-4239-4add-80b7-ba399d17378d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.015511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de2c60-4239-4add-80b7-ba399d17378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.032887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 836/1612] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:01.035112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e600b-1480-4634-be3d-a09478027507 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.035418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e600b-1480-4634-be3d-a09478027507 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.035736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e600b-1480-4634-be3d-a09478027507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.039037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e9de2c60-4239-4add-80b7-ba399d17378d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:01.041836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e9de2c60-4239-4add-80b7-ba399d17378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:01.054986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 777/1613] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:01.054986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de2c60-4239-4add-80b7-ba399d17378d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.084007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-522e600b-1480-4634-be3d-a09478027507 None None] MFA Rules not processed for user `4645bdadbc8a4951a3237bcd3fd07500`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:01.085831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-522e600b-1480-4634-be3d-a09478027507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:01.132363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de2c60-4239-4add-80b7-ba399d17378d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.138299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.139678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.140018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.142403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.154948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:01.158525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:01.175429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 778/1614] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:01.184617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.185303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 837/1615] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:01.186752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe5294-c832-4637-9542-f3b87a78a4c2 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.187471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe5294-c832-4637-9542-f3b87a78a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.187865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe5294-c832-4637-9542-f3b87a78a4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.205126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b57715-76e0-4dc7-9801-302c9d560839 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.215357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.216056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.216520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.216892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.217741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:01.220649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:01.225696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f8fe5294-c832-4637-9542-f3b87a78a4c2 None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:01.227314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f8fe5294-c832-4637-9542-f3b87a78a4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:01.257988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 779/1616] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:01 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:01.259198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.291132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:01.334988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 838/1617] 10.222.0.43 () {58 vars in 1058 bytes} [Mon Jun 20 18:46:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:01.336086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe5294-c832-4637-9542-f3b87a78a4c2 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.347414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:01.356188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe5294-c832-4637-9542-f3b87a78a4c2 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.412054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0655ce8-4f63-4c28-b3d5-149b050f477d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.423327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.426045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.427285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.428364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.495839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.496700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.497089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.498530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.578200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:01.584370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:01.603848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 780/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:01.606591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.620161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedcb1f-977d-460c-b611-9bef572bbd2c service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.630408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:01.632339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:01.634750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.635943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.636076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.636268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.716111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 839/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:01.716111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.719094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:01.719094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:01.720117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10570cb6-4db4-4181-96e0-9921b80308a4 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.720117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.720117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.720117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.720508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.720508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:01.720508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:01.726625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 781/1620] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:01 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:01.728049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.757915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 840/1621] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:01 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:01.758739 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.795735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6bbb6-1283-4399-b9fc-e5512f6d02a4 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.858503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cbd4f-fa8a-4fd6-b3b5-5ce181baeab7 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.865905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.867239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.867695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.868328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.915767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:01.917400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:01.917758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:01.918258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:01.941225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:01.945206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:01.975877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 841/1622] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:01 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:01.976601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:01.992744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33926639-37e7-485a-8849-9959217a74f6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:01.995887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:02.010801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.011682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.011887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.013771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.013926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.018292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.037186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 842/1623] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:02.038165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.055851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.058238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.069658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b97f7-737f-4c2e-adb5-2af5eaf7ba6c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.075315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 782/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:02.076301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.090508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b1c57-ab42-46ce-b5ef-974fa484a00a service nova] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.091741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.092630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.092855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.093143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.093935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.095624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.097252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.117132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.117435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.117728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] PATH_INFO: `/v3/projects/9d2b5c18663447e0b1d55896c07101f1/users/52e925ae516c4b279eb8f54c3ff55af8/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.122708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 843/1625] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:02.126951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.136119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:02.149145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2b5c18663447e0b1d55896c07101f1, user_id=52e925ae516c4b279eb8f54c3ff55af8, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.151833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe0e5d-783a-4fe0-87e1-df89a61a77e1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.153751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.170964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.171908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.172203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.172542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] PATH_INFO: `/v3/projects/d2696581f5ea46989ff33e2eda01dab0/users/2eb9362741864e0e90a443b66b6db935/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.187785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 783/1626] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:02 2022] PUT /identity/v3/projects/9d2b5c18663447e0b1d55896c07101f1/users/52e925ae516c4b279eb8f54c3ff55af8/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:02.193629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.213286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2696581f5ea46989ff33e2eda01dab0, user_id=2eb9362741864e0e90a443b66b6db935, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.216521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.246237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 844/1627] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:02 2022] PUT /identity/v3/projects/d2696581f5ea46989ff33e2eda01dab0/users/2eb9362741864e0e90a443b66b6db935/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:02.250725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.303898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d14fc-2395-403a-9f34-453f25ee1ade admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.417772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89193512-f683-426a-8c77-34227a117a02 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.431628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.432503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.432702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.433058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.434115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.436086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.450759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.451516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.451799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.452089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.452832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.454448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.469089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 845/1628] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:46:02.472410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.491418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 784/1629] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:02.494706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.497655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48668e6-e829-4af1-93fd-c5d1ceabbe6c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.516550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc8c4b-406a-4c3d-9214-f74c2d6c6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.517488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8c4b-406a-4c3d-9214-f74c2d6c6fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.517783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8c4b-406a-4c3d-9214-f74c2d6c6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.518600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8c4b-406a-4c3d-9214-f74c2d6c6fb8 admin admin] PATH_INFO: `/v3/projects/d2696581f5ea46989ff33e2eda01dab0/users/2eb9362741864e0e90a443b66b6db935/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.524782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc8c4b-406a-4c3d-9214-f74c2d6c6fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2696581f5ea46989ff33e2eda01dab0, user_id=2eb9362741864e0e90a443b66b6db935, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.526653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a2fe-6f83-4027-a2cc-72f0c59741d2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.528027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc8c4b-406a-4c3d-9214-f74c2d6c6fb8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.537827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0f4c2-2477-4719-9400-87850837d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.538547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f4c2-2477-4719-9400-87850837d579 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.538841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f4c2-2477-4719-9400-87850837d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.539342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f4c2-2477-4719-9400-87850837d579 admin admin] PATH_INFO: `/v3/projects/9d2b5c18663447e0b1d55896c07101f1/users/52e925ae516c4b279eb8f54c3ff55af8/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.547431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0f4c2-2477-4719-9400-87850837d579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2b5c18663447e0b1d55896c07101f1, user_id=52e925ae516c4b279eb8f54c3ff55af8, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.552215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 846/1630] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:02 2022] PUT /identity/v3/projects/d2696581f5ea46989ff33e2eda01dab0/users/2eb9362741864e0e90a443b66b6db935/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:02.555595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae7009-8ca7-48cc-8cb2-c73409e3a9ee None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.555897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae7009-8ca7-48cc-8cb2-c73409e3a9ee None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.556186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae7009-8ca7-48cc-8cb2-c73409e3a9ee None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.557580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 847/1631] 10.222.0.43 () {54 vars in 912 bytes} [Mon Jun 20 18:46:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:02.564009 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0f4c2-2477-4719-9400-87850837d579 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:02.566043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970c4e-25a4-49f5-9c3d-3b95069ba1ae None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.566350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970c4e-25a4-49f5-9c3d-3b95069ba1ae None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.566642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970c4e-25a4-49f5-9c3d-3b95069ba1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.593346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 785/1632] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:02 2022] PUT /identity/v3/projects/9d2b5c18663447e0b1d55896c07101f1/users/52e925ae516c4b279eb8f54c3ff55af8/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:02.596898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba71e-58a9-4f29-8f57-d482612ea58d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.597198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba71e-58a9-4f29-8f57-d482612ea58d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.597481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba71e-58a9-4f29-8f57-d482612ea58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.633178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ed970c4e-25a4-49f5-9c3d-3b95069ba1ae None None] MFA Rules not processed for user `2eb9362741864e0e90a443b66b6db935`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:02.634759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ed970c4e-25a4-49f5-9c3d-3b95069ba1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:02.644366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-343ba71e-58a9-4f29-8f57-d482612ea58d None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:02.645911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-343ba71e-58a9-4f29-8f57-d482612ea58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:02.730198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:02.789978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 786/1633] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:46:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:02.791678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3530c1-69c0-4178-8405-3ee84229c11b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.792475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3530c1-69c0-4178-8405-3ee84229c11b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.792989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3530c1-69c0-4178-8405-3ee84229c11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.817030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 848/1634] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:02.819937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed970c4e-25a4-49f5-9c3d-3b95069ba1ae None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.858803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bd3530c1-69c0-4178-8405-3ee84229c11b None None] MFA Rules not processed for user `52e925ae516c4b279eb8f54c3ff55af8`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:02.860520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bd3530c1-69c0-4178-8405-3ee84229c11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:02.951538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:02.964395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed970c4e-25a4-49f5-9c3d-3b95069ba1ae None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:02.975164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:02.975991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:02.976314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:02.976662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:02.992466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:02.993916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 787/1635] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:02.994776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3530c1-69c0-4178-8405-3ee84229c11b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:02.996013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:03.024965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3530c1-69c0-4178-8405-3ee84229c11b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:03.039299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 849/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:03.040603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:03.041290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:03.041564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:03.041860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:03.054695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:03.056854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:03.079448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 788/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:03.191551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:03.207373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3681-1688-4c56-800c-ba93f2bcd1c9 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:03.214753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8be9c7-4531-40af-b4dd-74c6b5a5a6fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:03.215805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be9c7-4531-40af-b4dd-74c6b5a5a6fe service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:03.216102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be9c7-4531-40af-b4dd-74c6b5a5a6fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:03.216434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be9c7-4531-40af-b4dd-74c6b5a5a6fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:03.237840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8be9c7-4531-40af-b4dd-74c6b5a5a6fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:03.241765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8be9c7-4531-40af-b4dd-74c6b5a5a6fe service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:03.303416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 850/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:03.632350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:03.649512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bef15-0e9e-4859-8728-ba1df3a0914a service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:03.673407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:03.675420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:03.675748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:03.676013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:03.826234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:03.830334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:03.873656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 789/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:04.726159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f24d-3cc0-46a2-a1d0-dd10b1795b3a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:04.726730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f24d-3cc0-46a2-a1d0-dd10b1795b3a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:04.726969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f24d-3cc0-46a2-a1d0-dd10b1795b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:04.801673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-75c2f24d-3cc0-46a2-a1d0-dd10b1795b3a None None] MFA Rules not processed for user `db8a2559379049d099a7724ffc0f7752`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:04.803388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-75c2f24d-3cc0-46a2-a1d0-dd10b1795b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:04.927625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:04.961665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 851/1640] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:04.981422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f24d-3cc0-46a2-a1d0-dd10b1795b3a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:05.022565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:05.069691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf42f7-c5b4-4c1c-b874-8edbae401b06 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:05.078031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:05.079158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.079663 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.079779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] PATH_INFO: `/v3/users/4645bdadbc8a4951a3237bcd3fd07500` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.082055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4645bdadbc8a4951a3237bcd3fd07500)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:05.085533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:05.172725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4645bdadbc8a4951a3237bcd3fd07500'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:05.186425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f24d-3cc0-46a2-a1d0-dd10b1795b3a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:05.195728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4645bdadbc8a4951a3237bcd3fd07500'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:05.199726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4516e2-aa9c-4203-8503-498427b251d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:05.200422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4516e2-aa9c-4203-8503-498427b251d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.203844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4516e2-aa9c-4203-8503-498427b251d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.204249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4516e2-aa9c-4203-8503-498427b251d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.207024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4516e2-aa9c-4203-8503-498427b251d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:05.210800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4516e2-aa9c-4203-8503-498427b251d4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:05.220218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4645bdadbc8a4951a3237bcd3fd07500'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:05.221003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4645bdadbc8a4951a3237bcd3fd07500'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:05.221736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-55d2beed-0919-4e82-ab0e-4623598964b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4645bdadbc8a4951a3237bcd3fd07500'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:05.280300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 790/1641] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:04 2022] DELETE /identity/v3/users/4645bdadbc8a4951a3237bcd3fd07500 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:05.282799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab3ed-b4f1-4e65-a525-641a757981cd None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.283257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab3ed-b4f1-4e65-a525-641a757981cd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.283498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab3ed-b4f1-4e65-a525-641a757981cd None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.296378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 852/1642] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:04 2022] POST /identity/v3/projects => generated 405 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:05.297008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 791/1643] 10.222.0.43 () {54 vars in 961 bytes} [Mon Jun 20 18:46:05 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:05.298154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c727-fc5b-4c39-a5b7-5153c871527c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.298467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c727-fc5b-4c39-a5b7-5153c871527c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.298783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c727-fc5b-4c39-a5b7-5153c871527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.300846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ab3ed-b4f1-4e65-a525-641a757981cd None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:05.305397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9b9ab3ed-b4f1-4e65-a525-641a757981cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:05.350755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3224c727-fc5b-4c39-a5b7-5153c871527c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:05.352208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3224c727-fc5b-4c39-a5b7-5153c871527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:05.495416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ab3ed-b4f1-4e65-a525-641a757981cd None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:05.507749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:05.516356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:05.517065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.517354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.517632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.518871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:05.520899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:05.553216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 853/1644] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:05.554410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b81f1-f37d-4614-83cb-a89a3f9c58e6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.554709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b81f1-f37d-4614-83cb-a89a3f9c58e6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.564905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b81f1-f37d-4614-83cb-a89a3f9c58e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.610660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 792/1645] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:05 2022] POST /identity/v3/users => generated 309 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:05.613431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:05.657896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-027b81f1-f37d-4614-83cb-a89a3f9c58e6 None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:05.659683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-027b81f1-f37d-4614-83cb-a89a3f9c58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:05.664674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec9ac-b9ee-4c10-81ef-d6c859070e6a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:05.691358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:05.692252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.693919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.695311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.698580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:05.729808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:05.771211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 793/1646] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:05.772476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:05.779548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:05.833043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 854/1647] 10.222.0.43 () {58 vars in 1058 bytes} [Mon Jun 20 18:46:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:05.833723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b81f1-f37d-4614-83cb-a89a3f9c58e6 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:05.864253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b81f1-f37d-4614-83cb-a89a3f9c58e6 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:05.879244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a6d30-bd81-4727-a3b9-7f5111b6fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:05.880421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6d30-bd81-4727-a3b9-7f5111b6fb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.880716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6d30-bd81-4727-a3b9-7f5111b6fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.881118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6d30-bd81-4727-a3b9-7f5111b6fb65 admin admin] PATH_INFO: `/v3/projects/594a8f86428243d0aa070d786773bba8/users/46c19f87d1a5419a9ea249535623c8d9/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.900792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:05.930725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6d30-bd81-4727-a3b9-7f5111b6fb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594a8f86428243d0aa070d786773bba8, user_id=46c19f87d1a5419a9ea249535623c8d9, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:05.931355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf5fd-3572-414b-a831-83d7d53fe6f6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:05.933641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6d30-bd81-4727-a3b9-7f5111b6fb65 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:05.941051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6e917-934f-45bd-b448-8c95f4529871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:05.941731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e917-934f-45bd-b448-8c95f4529871 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.942079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e917-934f-45bd-b448-8c95f4529871 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.942319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e917-934f-45bd-b448-8c95f4529871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.975571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 855/1648] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:05 2022] PUT /identity/v3/projects/594a8f86428243d0aa070d786773bba8/users/46c19f87d1a5419a9ea249535623c8d9/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:05.977084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c519-f3a5-4b59-a705-c571d379cbfe None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:05.977431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c519-f3a5-4b59-a705-c571d379cbfe None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:05.977721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c519-f3a5-4b59-a705-c571d379cbfe None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:05.980779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 856/1649] 10.222.0.43 () {54 vars in 912 bytes} [Mon Jun 20 18:46:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:05.982256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3c519-f3a5-4b59-a705-c571d379cbfe None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:05.990380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6e917-934f-45bd-b448-8c95f4529871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:05.997001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6e917-934f-45bd-b448-8c95f4529871 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:06.025486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 794/1650] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:06.029205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:06.029504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:06.029794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:06.072218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:06.075578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:06.155674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3c519-f3a5-4b59-a705-c571d379cbfe None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:06.165066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:06.165907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:06.166203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:06.166666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:06.167474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:06.169161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:06.201840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 857/1651] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:06.203351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:06.227629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eaa32-8364-42c0-833e-dc01c149a7e3 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:06.240987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:06.241813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:06.242106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:06.242443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] PATH_INFO: `/v3/projects/594a8f86428243d0aa070d786773bba8/users/46c19f87d1a5419a9ea249535623c8d9/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:06.248493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594a8f86428243d0aa070d786773bba8, user_id=46c19f87d1a5419a9ea249535623c8d9, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:06.251126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 795/1652] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:46:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:06.251250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:06.267974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:06.271480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:06.280981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 858/1653] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:06 2022] PUT /identity/v3/projects/594a8f86428243d0aa070d786773bba8/users/46c19f87d1a5419a9ea249535623c8d9/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:06.451738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5824605-5a59-4146-9822-6160244c4bf0 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:06.574103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:06.574103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:06.574495 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:06.575097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:06.656211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:06.720598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:06.726151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:06.781615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 796/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:46:07.694229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:07.696333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:07.802067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:07.861584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837a914-642d-48e1-a2c1-0da97e8a0047 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:07.906891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:07.909694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:07.910173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:07.910603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] PATH_INFO: `/v3/projects/16e7a4e87e2749c5a2e86f72363f00f2` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:07.913799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e7a4e87e2749c5a2e86f72363f00f2)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:07.920786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:08.006229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e7a4e87e2749c5a2e86f72363f00f2', 'request_id': 'req-9e5505a3-e2f0-4024-945d-2f704768a030'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.021417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e7a4e87e2749c5a2e86f72363f00f2', 'request_id': 'req-9e5505a3-e2f0-4024-945d-2f704768a030'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.029533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e7a4e87e2749c5a2e86f72363f00f2', 'request_id': 'req-9e5505a3-e2f0-4024-945d-2f704768a030'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.061293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] The token cache is being invalidate because project 16e7a4e87e2749c5a2e86f72363f00f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:08.061293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.062669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9e5505a3-e2f0-4024-945d-2f704768a030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.069838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 859/1655] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:07 2022] DELETE /identity/v3/projects/16e7a4e87e2749c5a2e86f72363f00f2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:08.071199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:08.090168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717449e7-cfec-4306-853a-5fc19432d47e service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:08.214052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:08.215938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:08.216418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:08.217099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] PATH_INFO: `/v3/users/2eb9362741864e0e90a443b66b6db935` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:08.220023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb9362741864e0e90a443b66b6db935)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:08.228906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:08.349152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb9362741864e0e90a443b66b6db935'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.371446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb9362741864e0e90a443b66b6db935'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.400381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb9362741864e0e90a443b66b6db935'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.402652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb9362741864e0e90a443b66b6db935'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.403397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3dc5101f-6a1a-4ec8-af50-c1ab72d585d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb9362741864e0e90a443b66b6db935'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:08.461709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 797/1656] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:08 2022] DELETE /identity/v3/users/2eb9362741864e0e90a443b66b6db935 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:10.181500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:10.182615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:10.183042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:10.251639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] MFA Rules not processed for user `46c19f87d1a5419a9ea249535623c8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:10.254553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:10.437594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 860/1657] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:10.501023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:10.502860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:10.503375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:10.561134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] MFA Rules not processed for user `016cfd43630b42f38efcd37ea9a66a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:10.563222 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:10.664467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:10.666946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:10.739025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:10.822094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 798/1658] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:10.838275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:10.845592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:10.965872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266cbca-f54e-48ed-8258-c1ece551fb6c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:10.984640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:10.986066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:10.986514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:10.987112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] PATH_INFO: `/v3/projects/d2696581f5ea46989ff33e2eda01dab0` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:10.989302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2696581f5ea46989ff33e2eda01dab0)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:11.000114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:11.003996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:11.125784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdbc8-da14-4a12-87e3-770334ef1d2d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:11.156602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2696581f5ea46989ff33e2eda01dab0', 'request_id': 'req-c9d332b0-603a-4d60-a680-0b3f2a107935'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:11.200112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2696581f5ea46989ff33e2eda01dab0', 'request_id': 'req-c9d332b0-603a-4d60-a680-0b3f2a107935'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:11.212563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2696581f5ea46989ff33e2eda01dab0', 'request_id': 'req-c9d332b0-603a-4d60-a680-0b3f2a107935'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:11.231559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] The token cache is being invalidate because project d2696581f5ea46989ff33e2eda01dab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:11.231951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:11.233028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c9d332b0-603a-4d60-a680-0b3f2a107935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:11.241242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 861/1659] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:10 2022] DELETE /identity/v3/projects/d2696581f5ea46989ff33e2eda01dab0 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:11.247788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4cc3-bf4d-4efa-a2e5-db3163a4df16 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.248084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4cc3-bf4d-4efa-a2e5-db3163a4df16 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.248368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4cc3-bf4d-4efa-a2e5-db3163a4df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.303737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:11.304609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.306206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1c6c4cc3-bf4d-4efa-a2e5-db3163a4df16 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:11.306616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.307034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.310519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1c6c4cc3-bf4d-4efa-a2e5-db3163a4df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:11.312911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:11.456049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 862/1660] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:11.464477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d8e19-bd15-4701-9100-359d6c73d989 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.464886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:11.465038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d8e19-bd15-4701-9100-359d6c73d989 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.466037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d8e19-bd15-4701-9100-359d6c73d989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.466740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:11.493296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 799/1661] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:11.512596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e30d8e19-bd15-4701-9100-359d6c73d989 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:11.513829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e30d8e19-bd15-4701-9100-359d6c73d989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:11.536533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 863/1662] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:11.540616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:11.555754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aae9c-42c4-46da-9a20-6c25c1c55940 service nova] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:11.567920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:11.568720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.569090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.569451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.570271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:11.575908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:11.577714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:11.620424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 800/1663] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:46:11.621207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d8e19-bd15-4701-9100-359d6c73d989 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:11.641968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d8e19-bd15-4701-9100-359d6c73d989 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:11.656712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:11.657416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.657706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.657993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.667353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:11.675509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:11.735892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 864/1664] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:11 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:11.740067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:11.750271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:11.758145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7400b5-0b7f-45fe-a949-346d30458f3c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:11.882386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:11.883268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.883559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.883840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.885387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:11.887040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:11.914522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 801/1665] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:11 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:11.919170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:11.936843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382f03-158a-4b77-89f2-938e5ef2241f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:11.944050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:11.944718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.945017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.945304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.946066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:11.947808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:11.968510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:11.981548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 865/1666] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:11.981981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633d28f-3f9c-487b-a92b-0b484ff77cdc admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:11.986942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a964f-e813-4b10-a894-3450d0aa773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:11.987687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a964f-e813-4b10-a894-3450d0aa773e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:11.988455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a964f-e813-4b10-a894-3450d0aa773e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:11.988751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a964f-e813-4b10-a894-3450d0aa773e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:11.989873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a964f-e813-4b10-a894-3450d0aa773e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:11.991866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a964f-e813-4b10-a894-3450d0aa773e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:12.023072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 802/1667] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:12.024213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:12.037587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120800-9da9-44c0-bad8-a3623da7128b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:12.044091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad8c49-e51a-4d03-ae42-62fcf35ebdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:12.045047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad8c49-e51a-4d03-ae42-62fcf35ebdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.045514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad8c49-e51a-4d03-ae42-62fcf35ebdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.045807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad8c49-e51a-4d03-ae42-62fcf35ebdb0 admin admin] PATH_INFO: `/v3/projects/613454363f4c4c2c81f83b938f3f6a1d/users/caaa3f571fa747b9a04f44525fe6a66b/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.069434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad8c49-e51a-4d03-ae42-62fcf35ebdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613454363f4c4c2c81f83b938f3f6a1d, user_id=caaa3f571fa747b9a04f44525fe6a66b, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:12.073198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad8c49-e51a-4d03-ae42-62fcf35ebdb0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:12.100085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 866/1668] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:12 2022] PUT /identity/v3/projects/613454363f4c4c2c81f83b938f3f6a1d/users/caaa3f571fa747b9a04f44525fe6a66b/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:12.113228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df157-c308-4d45-8171-381fa562c832 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.114321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df157-c308-4d45-8171-381fa562c832 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.115655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990df157-c308-4d45-8171-381fa562c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.183740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.184316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.187916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.194249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-990df157-c308-4d45-8171-381fa562c832 None None] MFA Rules not processed for user `caaa3f571fa747b9a04f44525fe6a66b`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:12.196002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-990df157-c308-4d45-8171-381fa562c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:12.256595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] MFA Rules not processed for user `60a36e18710443359ba2a56ad2810043`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:12.267419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:12.323999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:12.392219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 803/1669] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:12.405798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df157-c308-4d45-8171-381fa562c832 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:12.415382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-990df157-c308-4d45-8171-381fa562c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:12.515754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 867/1670] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:12.526007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:12.528991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:12.568315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990df157-c308-4d45-8171-381fa562c832 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:12.582649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa713b-0586-45a0-ad28-b895764f0cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:12.583712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa713b-0586-45a0-ad28-b895764f0cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.585158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa713b-0586-45a0-ad28-b895764f0cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.585646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa713b-0586-45a0-ad28-b895764f0cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.603579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa713b-0586-45a0-ad28-b895764f0cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:12.605388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa713b-0586-45a0-ad28-b895764f0cc8 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:12.640992 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 804/1671] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:12.690453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791063e-35c3-4dbb-bd6d-6ffeef9aa15c None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.690860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791063e-35c3-4dbb-bd6d-6ffeef9aa15c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.691265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791063e-35c3-4dbb-bd6d-6ffeef9aa15c None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.693078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 805/1672] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:12.697252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791063e-35c3-4dbb-bd6d-6ffeef9aa15c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:12.730942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:12.762381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877e737-8b01-4b15-8f15-776073ce7b44 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:12.778545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2759e-e758-48fe-8c18-1657c9a97882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:12.779179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2759e-e758-48fe-8c18-1657c9a97882 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.786429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2759e-e758-48fe-8c18-1657c9a97882 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.787093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2759e-e758-48fe-8c18-1657c9a97882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.813595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791063e-35c3-4dbb-bd6d-6ffeef9aa15c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:12.815945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2759e-e758-48fe-8c18-1657c9a97882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:12.819484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:12.820788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.821086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.821536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] PATH_INFO: `/v3/users/caaa3f571fa747b9a04f44525fe6a66b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.824576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaa3f571fa747b9a04f44525fe6a66b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:12.825078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2759e-e758-48fe-8c18-1657c9a97882 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:12.826778 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:12.849101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 868/1673] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:12.850943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2971eb8-a49e-4537-9164-3b5b0c74cb3b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:12.851388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2971eb8-a49e-4537-9164-3b5b0c74cb3b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:12.851829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2971eb8-a49e-4537-9164-3b5b0c74cb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:12.924507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b2971eb8-a49e-4537-9164-3b5b0c74cb3b None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:12.928700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b2971eb8-a49e-4537-9164-3b5b0c74cb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:12.985252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaa3f571fa747b9a04f44525fe6a66b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:13.006028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaa3f571fa747b9a04f44525fe6a66b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:13.024794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaa3f571fa747b9a04f44525fe6a66b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:13.033249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaa3f571fa747b9a04f44525fe6a66b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:13.037456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c105fe36-98c2-4c09-882a-bf46814796a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaa3f571fa747b9a04f44525fe6a66b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:13.128015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 806/1674] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:12 2022] DELETE /identity/v3/users/caaa3f571fa747b9a04f44525fe6a66b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:13.134989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253a07c-4091-47ab-9edb-52d8caebd04e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:13.135387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253a07c-4091-47ab-9edb-52d8caebd04e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:13.135750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253a07c-4091-47ab-9edb-52d8caebd04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:13.140508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 869/1675] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:46:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:13.176187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d253a07c-4091-47ab-9edb-52d8caebd04e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:13.189549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d253a07c-4091-47ab-9edb-52d8caebd04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:13.369871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 807/1676] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:13.393497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68ff2-1ff7-4f67-bbf7-b66d82ad040f None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:13.394447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68ff2-1ff7-4f67-bbf7-b66d82ad040f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:13.395582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68ff2-1ff7-4f67-bbf7-b66d82ad040f None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:13.397215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 870/1677] 10.222.0.43 () {54 vars in 960 bytes} [Mon Jun 20 18:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:13.403855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:13.405707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:13.406150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:13.446174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:13.450295 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:13.557459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:13.609764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 808/1678] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Jun 20 18:46:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:13.617699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68ff2-1ff7-4f67-bbf7-b66d82ad040f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:13.652672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68ff2-1ff7-4f67-bbf7-b66d82ad040f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:13.662542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:13.665357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:13.687881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:13.689328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:13.693532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:13.693922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:13.720230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:13.724985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:13.768609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 871/1679] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:46:13.800978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bf9d5-f286-412a-af99-fa6624b644be None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:13.806399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:13.807412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:13.807932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:13.808308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:13.831777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:13.833501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:13.848375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 809/1680] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:15.165086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:15.166965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:15.189208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8262a97-4af7-469c-acb4-f22ea48d0afe service placement] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:15.202854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:15.203793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:15.204588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:15.206979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] PATH_INFO: `/v3/users/db8a2559379049d099a7724ffc0f7752` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:15.208886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8a2559379049d099a7724ffc0f7752)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:15.213120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: WARNING py.warnings [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:46:15.213120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: warnings.warn(msg) Jun 20 18:46:15.213120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: Jun 20 18:46:15.217346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:15.313311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:15.381697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8a2559379049d099a7724ffc0f7752'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:15.404926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8a2559379049d099a7724ffc0f7752'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:15.405650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8a2559379049d099a7724ffc0f7752'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:15.429889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8a2559379049d099a7724ffc0f7752'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:15.489913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8a2559379049d099a7724ffc0f7752'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:15.510724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 872/1681] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:15 2022] DELETE /identity/v3/users/db8a2559379049d099a7724ffc0f7752 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:16.570147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:16.572234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:16.592184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da592-0fe9-4a40-b18f-fc95e26be2ea service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:16.689375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:16.690390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:16.690812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:16.691145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] PATH_INFO: `/v3/projects/613454363f4c4c2c81f83b938f3f6a1d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:16.692644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613454363f4c4c2c81f83b938f3f6a1d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:16.696430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: WARNING py.warnings [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 18:46:16.696430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: warnings.warn(msg) Jun 20 18:46:16.696430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: Jun 20 18:46:16.698094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:16.754593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:16.757973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:16.790783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82928a-16c0-4c60-9c23-5bde4dea8b1e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:16.805450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:16.806750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:16.814232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:16.816872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] PATH_INFO: `/v3/projects/fe5a616fa25d4234a30e36bf6278e68f` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:16.822199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5a616fa25d4234a30e36bf6278e68f)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:16.825887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:16.925419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613454363f4c4c2c81f83b938f3f6a1d', 'request_id': 'req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:16.936834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613454363f4c4c2c81f83b938f3f6a1d', 'request_id': 'req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:16.957149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613454363f4c4c2c81f83b938f3f6a1d', 'request_id': 'req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:16.964405 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5a616fa25d4234a30e36bf6278e68f', 'request_id': 'req-642786d7-1e4c-4206-ac59-cf467d4d601e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:16.988261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5a616fa25d4234a30e36bf6278e68f', 'request_id': 'req-642786d7-1e4c-4206-ac59-cf467d4d601e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:16.990536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] The token cache is being invalidate because project 613454363f4c4c2c81f83b938f3f6a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:16.990837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:16.992450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f38c3098-0b35-44c5-b9e4-bcd0a94197b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:16.998662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 810/1682] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:16 2022] DELETE /identity/v3/projects/613454363f4c4c2c81f83b938f3f6a1d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:16.999428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5a616fa25d4234a30e36bf6278e68f', 'request_id': 'req-642786d7-1e4c-4206-ac59-cf467d4d601e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.003501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a248c9-4682-455a-b31c-bb0efbc40bf7 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.003808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a248c9-4682-455a-b31c-bb0efbc40bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.004274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a248c9-4682-455a-b31c-bb0efbc40bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.028614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] The token cache is being invalidate because project fe5a616fa25d4234a30e36bf6278e68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:17.028801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.029908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.032084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:17.044751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 873/1683] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:16 2022] DELETE /identity/v3/projects/fe5a616fa25d4234a30e36bf6278e68f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:17.046063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:17.049831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:17.054674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d1a248c9-4682-455a-b31c-bb0efbc40bf7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:17.056498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d1a248c9-4682-455a-b31c-bb0efbc40bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:17.196391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642786d7-1e4c-4206-ac59-cf467d4d601e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:17.201509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 811/1684] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:17.207753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:17.209920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.210484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.211040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] PATH_INFO: `/v3/users/46c19f87d1a5419a9ea249535623c8d9` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.211522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d084dd-b927-4166-b9a2-0151acd53b45 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.211823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d084dd-b927-4166-b9a2-0151acd53b45 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.212112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d084dd-b927-4166-b9a2-0151acd53b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.215127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c19f87d1a5419a9ea249535623c8d9)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:17.218062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:17.250870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-14d084dd-b927-4166-b9a2-0151acd53b45 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:17.256384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-14d084dd-b927-4166-b9a2-0151acd53b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:17.272605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:17.275866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 812/1685] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:17.281118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d084dd-b927-4166-b9a2-0151acd53b45 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:17.310908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d084dd-b927-4166-b9a2-0151acd53b45 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:17.326070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:17.327812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c19f87d1a5419a9ea249535623c8d9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.330178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.331910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.332932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.334771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:17.335220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:17.338632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:17.349000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c19f87d1a5419a9ea249535623c8d9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.349826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c19f87d1a5419a9ea249535623c8d9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.363550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c19f87d1a5419a9ea249535623c8d9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.376454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 813/1686] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:46:17.405724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:17.421079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c19f87d1a5419a9ea249535623c8d9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:17.439143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 874/1687] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:17 2022] DELETE /identity/v3/users/46c19f87d1a5419a9ea249535623c8d9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:17.440474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4316f-32eb-4a4c-a580-568f2b8b7f48 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:17.548572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da6d40-1ef1-4eb6-95f1-004fb8f9b7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:17.550436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6d40-1ef1-4eb6-95f1-004fb8f9b7fb admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.550962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6d40-1ef1-4eb6-95f1-004fb8f9b7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.551937 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da6d40-1ef1-4eb6-95f1-004fb8f9b7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.553192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da6d40-1ef1-4eb6-95f1-004fb8f9b7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:17.556130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da6d40-1ef1-4eb6-95f1-004fb8f9b7fb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:17.615872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 814/1688] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:17 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:17.620550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:17.624598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:17.651606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092e6f4-7ff6-42da-a936-749e5a956a97 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.652141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092e6f4-7ff6-42da-a936-749e5a956a97 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.652626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092e6f4-7ff6-42da-a936-749e5a956a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.687662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bcf19-f489-4f30-b58e-988a7621a391 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:17.732806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4092e6f4-7ff6-42da-a936-749e5a956a97 None None] MFA Rules not processed for user `016cfd43630b42f38efcd37ea9a66a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:17.738206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4092e6f4-7ff6-42da-a936-749e5a956a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:17.820093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:17.820811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.821201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.821499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.822230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:17.824883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:17.842960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 815/1689] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:17.873879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 875/1690] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:17 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:17.875177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092e6f4-7ff6-42da-a936-749e5a956a97 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:17.899064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092e6f4-7ff6-42da-a936-749e5a956a97 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:17.916603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:17.917311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.917599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.917880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.918630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:17.920318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:17.943544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 816/1691] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:17.947017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:17.964437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9375b2b-1174-44cb-9679-aa4d082e999a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:17.971665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2877b54-d6ef-4e3a-a79e-502f122b8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:17.972365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877b54-d6ef-4e3a-a79e-502f122b8472 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:17.972658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877b54-d6ef-4e3a-a79e-502f122b8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:17.972944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2877b54-d6ef-4e3a-a79e-502f122b8472 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:17.973694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2877b54-d6ef-4e3a-a79e-502f122b8472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:17.975403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2877b54-d6ef-4e3a-a79e-502f122b8472 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:18.003653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 876/1692] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:18.007643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:18.012914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:18.020283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6c3c9-0ac5-4c08-8341-758db8165503 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:18.035602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:18.036530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:18.037428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:18.037428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] PATH_INFO: `/v3/projects/01e2b95296f749b1ae84468756e974bd/users/71c34dd2b42c4df79ed2eb4de3a5a8f3/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:18.073853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e2b95296f749b1ae84468756e974bd, user_id=71c34dd2b42c4df79ed2eb4de3a5a8f3, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:18.076758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:18.104700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 817/1693] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:18 2022] PUT /identity/v3/projects/01e2b95296f749b1ae84468756e974bd/users/71c34dd2b42c4df79ed2eb4de3a5a8f3/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:18.115695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:18.116291 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:18.116875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:18.170119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] MFA Rules not processed for user `71c34dd2b42c4df79ed2eb4de3a5a8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:18.171984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:18.286239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 877/1694] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:18.304783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:18.309839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:18.348755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:18.351041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:18.394759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:18.415569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509994-d024-4071-8b56-7fccbb85f872 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:18.432658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2862-68c2-470f-9cb2-2a5a4feeca8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:18.434952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2862-68c2-470f-9cb2-2a5a4feeca8c service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:18.435403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2862-68c2-470f-9cb2-2a5a4feeca8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:18.435557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2862-68c2-470f-9cb2-2a5a4feeca8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:18.451493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2862-68c2-470f-9cb2-2a5a4feeca8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:18.452997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2862-68c2-470f-9cb2-2a5a4feeca8c service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:18.475306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 818/1695] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:18.476948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e4cc8-03d5-4b4e-b820-cce4c3e5f251 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:18.477361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e4cc8-03d5-4b4e-b820-cce4c3e5f251 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:18.477702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e4cc8-03d5-4b4e-b820-cce4c3e5f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:18.528925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6b6e4cc8-03d5-4b4e-b820-cce4c3e5f251 None None] MFA Rules not processed for user `2ada4576c0084912b41c846d849ce6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:18.530728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6b6e4cc8-03d5-4b4e-b820-cce4c3e5f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:18.621139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 819/1696] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:18.636080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:18.636413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:18.637621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:18.669956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7abfb2-4a1a-4149-a273-45f4c4286097 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:18.676323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:18.677353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:18.677714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:18.678092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] PATH_INFO: `/v3/projects/594a8f86428243d0aa070d786773bba8` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:18.684276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=594a8f86428243d0aa070d786773bba8)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:18.688708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:18.722543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] MFA Rules not processed for user `2ada4576c0084912b41c846d849ce6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:18.726010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:18.744665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 820/1697] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:18.844831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594a8f86428243d0aa070d786773bba8', 'request_id': 'req-a0420020-34b1-4e31-ac2b-0d00223bc33a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:18.859494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:18.862095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:18.886053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594a8f86428243d0aa070d786773bba8', 'request_id': 'req-a0420020-34b1-4e31-ac2b-0d00223bc33a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:18.914183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594a8f86428243d0aa070d786773bba8', 'request_id': 'req-a0420020-34b1-4e31-ac2b-0d00223bc33a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:18.963424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] The token cache is being invalidate because project 594a8f86428243d0aa070d786773bba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:18.963739 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:18.965119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a0420020-34b1-4e31-ac2b-0d00223bc33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:18.973553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 878/1698] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:18 2022] DELETE /identity/v3/projects/594a8f86428243d0aa070d786773bba8 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:18.975559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1adac9-05ea-4d17-8184-8775543f689c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:18.975972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1adac9-05ea-4d17-8184-8775543f689c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:18.976272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1adac9-05ea-4d17-8184-8775543f689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.054558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9b1adac9-05ea-4d17-8184-8775543f689c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:19.061769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9b1adac9-05ea-4d17-8184-8775543f689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:19.121330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:19.140523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef76a1b-eb78-4256-8ea9-7f96f32f378e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:19.233625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 879/1699] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:19.241204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524458-4579-4e12-ab1b-1c5c522c6c56 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.241671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524458-4579-4e12-ab1b-1c5c522c6c56 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.242068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524458-4579-4e12-ab1b-1c5c522c6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.277683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ee524458-4579-4e12-ab1b-1c5c522c6c56 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:19.279033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ee524458-4579-4e12-ab1b-1c5c522c6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:19.305657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 880/1700] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:19.307612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524458-4579-4e12-ab1b-1c5c522c6c56 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:19.322427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524458-4579-4e12-ab1b-1c5c522c6c56 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:19.337225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:19.337915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.338266 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.338539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.339697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:19.340018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:19.342166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:19.410133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1f498-48ab-46e7-b53b-599cfe1f48d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:19.411089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f498-48ab-46e7-b53b-599cfe1f48d2 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.411961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f498-48ab-46e7-b53b-599cfe1f48d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.412686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f498-48ab-46e7-b53b-599cfe1f48d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.415256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 881/1701] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:46:19.416368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:19.418690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-cbd1f498-48ab-46e7-b53b-599cfe1f48d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:19.437914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14127873-1a3f-4e40-97e9-1052659b9725 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:19.448713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:19.449793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.450151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.450652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.451657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:19.453542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:19.472999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:19.499578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 882/1702] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:19 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:19.500962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:19.510994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1f498-48ab-46e7-b53b-599cfe1f48d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:19.512949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1f498-48ab-46e7-b53b-599cfe1f48d2 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:19.530974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 821/1703] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:46:19.575944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf25c19-d0dd-4f32-bf40-5fd48aa1d547 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.576743 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf25c19-d0dd-4f32-bf40-5fd48aa1d547 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.577622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf25c19-d0dd-4f32-bf40-5fd48aa1d547 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.579674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 822/1704] 10.222.0.43 () {54 vars in 912 bytes} [Mon Jun 20 18:46:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:46:19.589704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693516-5767-46c9-950f-88f74455aee8 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.591883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693516-5767-46c9-950f-88f74455aee8 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.594253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693516-5767-46c9-950f-88f74455aee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.657183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5fa91-0364-43aa-be24-fae038a774a5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:19.672687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587d4fa-dc26-4ab4-940c-5e72f4859482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:19.673389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d4fa-dc26-4ab4-940c-5e72f4859482 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.673822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d4fa-dc26-4ab4-940c-5e72f4859482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.675869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d4fa-dc26-4ab4-940c-5e72f4859482 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.676556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587d4fa-dc26-4ab4-940c-5e72f4859482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:19.682991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587d4fa-dc26-4ab4-940c-5e72f4859482 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:19.696658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4f693516-5767-46c9-950f-88f74455aee8 None None] MFA Rules not processed for user `b3d7fbf23c584c32a518abd0b5326229`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:19.700265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4f693516-5767-46c9-950f-88f74455aee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:19.730645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 883/1705] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:19 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:19.732126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0583f6-304f-4483-9b4c-1132dc18be5e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.732399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0583f6-304f-4483-9b4c-1132dc18be5e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.732731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0583f6-304f-4483-9b4c-1132dc18be5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.813293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2a0583f6-304f-4483-9b4c-1132dc18be5e None None] MFA Rules not processed for user `c3134832f2a647aab761da347f7e9fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:19.814688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2a0583f6-304f-4483-9b4c-1132dc18be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:19.876061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 823/1706] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:46:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:19.877518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f693516-5767-46c9-950f-88f74455aee8 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:19.910248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f693516-5767-46c9-950f-88f74455aee8 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:19.941288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:19.941985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:19.942339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:19.942630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:19.943921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:19.945596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:19.972785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 824/1707] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:19.973751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:19.989631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4c0d-e36f-499f-9086-a8a5cc99c81b admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:19.997040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 884/1708] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:20.003114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:20.003995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.004291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.005297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.008256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:20.015359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:20.035230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0583f6-304f-4483-9b4c-1132dc18be5e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:20.048780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 825/1709] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:20.060383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0583f6-304f-4483-9b4c-1132dc18be5e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:20.075397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751c9c8-14d4-4967-9a6f-4018bf436a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:20.076431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751c9c8-14d4-4967-9a6f-4018bf436a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.076736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751c9c8-14d4-4967-9a6f-4018bf436a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.077042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751c9c8-14d4-4967-9a6f-4018bf436a88 admin admin] PATH_INFO: `/v3/projects/0a3800ec4a7c4840999b19a2a3d86551/users/423a1cb9b9024a9c8ff8e9f4eb5d45c3/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.112673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751c9c8-14d4-4967-9a6f-4018bf436a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3800ec4a7c4840999b19a2a3d86551, user_id=423a1cb9b9024a9c8ff8e9f4eb5d45c3, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:20.114861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:20.116851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:20.142588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751c9c8-14d4-4967-9a6f-4018bf436a88 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:20.161061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d402-9fc2-411a-814f-9b479b0bea98 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:20.180493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147dddc-9557-4fb4-bced-3b7f35f4c45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:20.181178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147dddc-9557-4fb4-bced-3b7f35f4c45e service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.181476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147dddc-9557-4fb4-bced-3b7f35f4c45e service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.181765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147dddc-9557-4fb4-bced-3b7f35f4c45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.192025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 885/1710] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:20 2022] PUT /identity/v3/projects/0a3800ec4a7c4840999b19a2a3d86551/users/423a1cb9b9024a9c8ff8e9f4eb5d45c3/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:20.202643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd86b-4402-4b79-a5c6-7457c4df6b41 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.202962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd86b-4402-4b79-a5c6-7457c4df6b41 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.203253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd86b-4402-4b79-a5c6-7457c4df6b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.227629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147dddc-9557-4fb4-bced-3b7f35f4c45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:20.229288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147dddc-9557-4fb4-bced-3b7f35f4c45e service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:20.246375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:20.284352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 826/1711] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:46:20.288949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea5f2-354e-45f2-b161-aec33cef5924 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.292902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea5f2-354e-45f2-b161-aec33cef5924 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.293405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea5f2-354e-45f2-b161-aec33cef5924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.298322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3f3dd86b-4402-4b79-a5c6-7457c4df6b41 None None] MFA Rules not processed for user `60a36e18710443359ba2a56ad2810043`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:20.300139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3f3dd86b-4402-4b79-a5c6-7457c4df6b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:20.379846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4adea5f2-354e-45f2-b161-aec33cef5924 None None] MFA Rules not processed for user `423a1cb9b9024a9c8ff8e9f4eb5d45c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:20.381822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4adea5f2-354e-45f2-b161-aec33cef5924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:20.413447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:20.436114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 886/1712] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:20.546616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd413-3c0f-4554-90da-60f3448d6e42 None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.547148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd413-3c0f-4554-90da-60f3448d6e42 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.547748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd413-3c0f-4554-90da-60f3448d6e42 None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.550168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 887/1713] 10.222.0.43 () {54 vars in 912 bytes} [Mon Jun 20 18:46:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:46:20.561529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.561773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.562781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.601896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] MFA Rules not processed for user `b3d7fbf23c584c32a518abd0b5326229`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:20.603461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:20.603895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 827/1714] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:20.612756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea5f2-354e-45f2-b161-aec33cef5924 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:20.727373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 888/1715] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:46:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:20.742713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:20.743890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea5f2-354e-45f2-b161-aec33cef5924 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:20.744342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:20.749502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:20.750380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.750810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.751285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.752846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:20.755110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:20.758238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a244-5dd5-42af-a028-485c26f55519 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:20.762766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:20.763533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.763905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.764256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.774420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:20.776735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:20.789948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 889/1716] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:46:20.792698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 828/1717] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:20 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:20.796499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:20.815408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88517e-1258-4c53-a2eb-8a68fe437448 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:20.914683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:20.915520 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:20.915814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:20.916117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:20.919407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:20.923535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:20.989140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 890/1718] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:20 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:20.993437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:21.013239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f9a88-94d1-40e5-9618-1e9098c87835 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:21.026732 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:21.027487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:21.028267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:21.028267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:21.028789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:21.033874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:21.066125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 829/1719] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:21.070068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:21.085201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bc05-cd47-4739-986f-a3fa448aba27 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:21.097525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:21.098456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:21.098751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:21.099069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] PATH_INFO: `/v3/projects/f9a4b324d067485584baff9169b34972/users/a2f46fdf631a4eb69d44d63366abaa2a/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:21.122941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:21.125437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:21.150770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a4b324d067485584baff9169b34972, user_id=a2f46fdf631a4eb69d44d63366abaa2a, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:21.157597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:21.193903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 891/1720] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:21 2022] PUT /identity/v3/projects/f9a4b324d067485584baff9169b34972/users/a2f46fdf631a4eb69d44d63366abaa2a/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:21.194730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:21.199706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:21.327623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432bb2d-b56c-4c59-a7b5-1bf5d07f9d15 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:21.340707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:21.364238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:21.419844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f17a-7bb2-4985-b85e-d36f1fd67b69 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:21.438499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:21.441931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:21.442220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:21.442499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:21.469369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:21.471620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:21.471918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:21.472203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:21.478375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:21.523368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:21.526244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:21.553940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 830/1721] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:21.556555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:21.625244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:21.627625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:21.670844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 892/1722] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:21.772712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42993713-576a-40e5-85d2-75a113cbaffc service placement] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:21.786959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d1a3d-2f51-4398-bfd6-f3117198afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:21.787754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d1a3d-2f51-4398-bfd6-f3117198afdb admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:21.788119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d1a3d-2f51-4398-bfd6-f3117198afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:21.788471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d1a3d-2f51-4398-bfd6-f3117198afdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:21.789431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d1a3d-2f51-4398-bfd6-f3117198afdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:21.791619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d1a3d-2f51-4398-bfd6-f3117198afdb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:21.839667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 831/1723] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:21.841378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:21.866738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02831b3c-37c9-4a43-97d4-bb58eb003d74 service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:21.888842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:21.897395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:21.897692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:21.897980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] PATH_INFO: `/v3/projects/f9a4b324d067485584baff9169b34972/users/a2f46fdf631a4eb69d44d63366abaa2a/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:21.907447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a4b324d067485584baff9169b34972, user_id=a2f46fdf631a4eb69d44d63366abaa2a, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:21.916895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:21.948940 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 893/1724] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:21 2022] PUT /identity/v3/projects/f9a4b324d067485584baff9169b34972/users/a2f46fdf631a4eb69d44d63366abaa2a/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:21.950535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d181de-c0f1-4527-8175-3aa1217515ad None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:21.951005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d181de-c0f1-4527-8175-3aa1217515ad None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:21.951449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d181de-c0f1-4527-8175-3aa1217515ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:22.006016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c7d181de-c0f1-4527-8175-3aa1217515ad None None] MFA Rules not processed for user `a2f46fdf631a4eb69d44d63366abaa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:22.007579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c7d181de-c0f1-4527-8175-3aa1217515ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:22.246193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 832/1725] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:22.330402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:22.334598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:22.614958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fae18-4e32-4891-81e5-56f6d167a71f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:22.628200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d280b8-2104-485f-b086-6181901464b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:22.631479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d280b8-2104-485f-b086-6181901464b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:22.632703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d280b8-2104-485f-b086-6181901464b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:22.634374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d280b8-2104-485f-b086-6181901464b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:22.669339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d280b8-2104-485f-b086-6181901464b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:22.679032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d280b8-2104-485f-b086-6181901464b4 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:22.715705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 894/1726] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:25.555571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d181de-c0f1-4527-8175-3aa1217515ad None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:25.584800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7557-bf3a-4ef1-a561-d558b7ad437e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:25.585497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7557-bf3a-4ef1-a561-d558b7ad437e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:25.585497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7557-bf3a-4ef1-a561-d558b7ad437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:25.610144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:25.632349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9fce7557-bf3a-4ef1-a561-d558b7ad437e None None] MFA Rules not processed for user `c3134832f2a647aab761da347f7e9fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:25.634259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9fce7557-bf3a-4ef1-a561-d558b7ad437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:25.754900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d181de-c0f1-4527-8175-3aa1217515ad None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:25.764191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:25.766325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:25.767442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:25.767442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] PATH_INFO: `/v3/users/423a1cb9b9024a9c8ff8e9f4eb5d45c3` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:25.770053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423a1cb9b9024a9c8ff8e9f4eb5d45c3)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:25.777312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:25.829445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 895/1727] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:25.877115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423a1cb9b9024a9c8ff8e9f4eb5d45c3'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:25.902065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423a1cb9b9024a9c8ff8e9f4eb5d45c3'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:25.924841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423a1cb9b9024a9c8ff8e9f4eb5d45c3'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:25.925491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423a1cb9b9024a9c8ff8e9f4eb5d45c3'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:25.926191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423a1cb9b9024a9c8ff8e9f4eb5d45c3'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:25.950119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 833/1728] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:25 2022] DELETE /identity/v3/users/423a1cb9b9024a9c8ff8e9f4eb5d45c3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:25.954293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5c6cc-723e-45ed-b3fc-1ff75f3e0a68 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:25.954639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5c6cc-723e-45ed-b3fc-1ff75f3e0a68 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:25.955104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5c6cc-723e-45ed-b3fc-1ff75f3e0a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:26.005817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a3d5c6cc-723e-45ed-b3fc-1ff75f3e0a68 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:26.007597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a3d5c6cc-723e-45ed-b3fc-1ff75f3e0a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:26.107762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:26.193377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 896/1729] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:26.203830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:26.205371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:26.444862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec43d-9a65-4379-aaa6-f999646465a2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:26.463681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:26.464880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:26.470050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:26.470528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:26.513062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:26.522383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:26.565685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 834/1730] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:27.225965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:27.226417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:27.226541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:27.300348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:27.305097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:27.505702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 897/1731] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:46:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:27.732355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:27.734054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:27.777942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be159f-f320-4cc1-9689-8ea31dfd44f6 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:27.804455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:27.807637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:27.811614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:27.816658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:27.817904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:27.818208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] PATH_INFO: `/v3/users/e13f3c0f9456465d8c9ceb206f958373` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:27.823094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13f3c0f9456465d8c9ceb206f958373)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:27.829574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:27.974981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:27.999225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13f3c0f9456465d8c9ceb206f958373'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:28.008262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cac3-d3fe-44a0-8aae-b9515f5edbd3 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:28.016572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13f3c0f9456465d8c9ceb206f958373'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:28.029014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a5d8e-69ba-4a58-a346-59df47122d07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:28.030035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5d8e-69ba-4a58-a346-59df47122d07 service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:28.030464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5d8e-69ba-4a58-a346-59df47122d07 service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:28.034594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13f3c0f9456465d8c9ceb206f958373'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:28.035284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13f3c0f9456465d8c9ceb206f958373'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:28.036270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13f3c0f9456465d8c9ceb206f958373'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:28.037615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5d8e-69ba-4a58-a346-59df47122d07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:28.040090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ea8a5d8e-69ba-4a58-a346-59df47122d07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:28.059438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5d8e-69ba-4a58-a346-59df47122d07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:28.061640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5d8e-69ba-4a58-a346-59df47122d07 service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:28.095164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 898/1732] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:46:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:46:28.098826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 835/1733] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:27 2022] DELETE /identity/v3/users/e13f3c0f9456465d8c9ceb206f958373 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:28.103963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:28.104264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:28.104551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:28.143265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:28.144441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:28.332803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 899/1734] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:28.503632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:28.505259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:28.721254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ab59d-6024-4ff5-9add-a8a13900caf7 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:28.734451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:28.735174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:28.738255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:28.739550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:28.766195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:28.768473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:28.797470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 836/1735] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:29.245232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:29.247085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:29.263575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:29.277056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc412b-814a-4268-958a-a2925b33af2e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:29.307235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:29.312027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:29.313303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:29.315022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] PATH_INFO: `/v3/projects/0a3800ec4a7c4840999b19a2a3d86551` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:29.321506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3800ec4a7c4840999b19a2a3d86551)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:29.324868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:29.474876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3800ec4a7c4840999b19a2a3d86551', 'request_id': 'req-67045fce-7b56-465b-b4c0-b18bc0e489a3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:29.493356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3800ec4a7c4840999b19a2a3d86551', 'request_id': 'req-67045fce-7b56-465b-b4c0-b18bc0e489a3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:29.513510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3800ec4a7c4840999b19a2a3d86551', 'request_id': 'req-67045fce-7b56-465b-b4c0-b18bc0e489a3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:29.549452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] The token cache is being invalidate because project 0a3800ec4a7c4840999b19a2a3d86551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:29.550625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:29.553261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:29.556142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 900/1736] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:29 2022] DELETE /identity/v3/projects/0a3800ec4a7c4840999b19a2a3d86551 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:29.561763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:29.580830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f392a0-be69-49ec-90a5-b70dfe02039c service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:29.810715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:29.812672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:29.813171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:29.813614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] PATH_INFO: `/v3/users/a2f46fdf631a4eb69d44d63366abaa2a` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:29.815293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f46fdf631a4eb69d44d63366abaa2a)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:29.817766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:29.958480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f46fdf631a4eb69d44d63366abaa2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:29.993409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f46fdf631a4eb69d44d63366abaa2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:29.996004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:30.019316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f46fdf631a4eb69d44d63366abaa2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.020606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f46fdf631a4eb69d44d63366abaa2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.025815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:30.028452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:30.035162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b9591340-4e12-40f9-af66-6e679d4b6040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f46fdf631a4eb69d44d63366abaa2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.082362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67045fce-7b56-465b-b4c0-b18bc0e489a3 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:30.093809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:30.098325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:30.098624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:30.098903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] PATH_INFO: `/v3/users/71c34dd2b42c4df79ed2eb4de3a5a8f3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:30.116798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 837/1737] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:29 2022] DELETE /identity/v3/users/a2f46fdf631a4eb69d44d63366abaa2a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:30.131709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c34dd2b42c4df79ed2eb4de3a5a8f3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:30.139880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:30.318339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c34dd2b42c4df79ed2eb4de3a5a8f3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.360498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c34dd2b42c4df79ed2eb4de3a5a8f3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.362795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c34dd2b42c4df79ed2eb4de3a5a8f3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.392149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c34dd2b42c4df79ed2eb4de3a5a8f3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.435923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-09a33c3d-2029-4641-a83c-a726d348096a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c34dd2b42c4df79ed2eb4de3a5a8f3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:30.449102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 901/1738] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:30 2022] DELETE /identity/v3/users/71c34dd2b42c4df79ed2eb4de3a5a8f3 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:30.455939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:30.456702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:30.457042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:30.517118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:30.519100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:30.630690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef2736-66e2-48ad-84d9-5e5cfd4bdbfe None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:30.631409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef2736-66e2-48ad-84d9-5e5cfd4bdbfe None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:30.631868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef2736-66e2-48ad-84d9-5e5cfd4bdbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:30.706443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-02ef2736-66e2-48ad-84d9-5e5cfd4bdbfe None None] MFA Rules not processed for user `b3d7fbf23c584c32a518abd0b5326229`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:30.707751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-02ef2736-66e2-48ad-84d9-5e5cfd4bdbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:30.772027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 838/1739] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:30.811782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 902/1740] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jun 20 18:46:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:30.828964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:30.831063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:30.853056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42290-a7e7-4853-a116-649ed49a24a5 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:30.864976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:30.865890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:30.866402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:30.866878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:30.888202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:30.899863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:30.934351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 839/1741] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:31.232881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef2736-66e2-48ad-84d9-5e5cfd4bdbfe None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:31.245949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef2736-66e2-48ad-84d9-5e5cfd4bdbfe None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:31.262771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b67b76-a3bf-46f2-819d-07524b8e6552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:31.263902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67b76-a3bf-46f2-819d-07524b8e6552 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:31.264358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67b76-a3bf-46f2-819d-07524b8e6552 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:31.264803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67b76-a3bf-46f2-819d-07524b8e6552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:31.287768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:31.294545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b67b76-a3bf-46f2-819d-07524b8e6552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:31.307683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b67b76-a3bf-46f2-819d-07524b8e6552 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:31.324383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 903/1742] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:31.570453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:31.572373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:31.597239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bdc18-91de-4a3c-a659-13f779eda85b service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:31.611898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:31.613454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:31.614689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:31.615216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] PATH_INFO: `/v3/projects/28aec5b111624af3a061ce7fd1a03b32` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:31.618091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28aec5b111624af3a061ce7fd1a03b32)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:31.620430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:31.742228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28aec5b111624af3a061ce7fd1a03b32', 'request_id': 'req-d7a6a1e4-86f4-419b-a971-4d813fead37f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:31.762369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28aec5b111624af3a061ce7fd1a03b32', 'request_id': 'req-d7a6a1e4-86f4-419b-a971-4d813fead37f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:31.772137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28aec5b111624af3a061ce7fd1a03b32', 'request_id': 'req-d7a6a1e4-86f4-419b-a971-4d813fead37f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:31.802311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] The token cache is being invalidate because project 28aec5b111624af3a061ce7fd1a03b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:31.802663 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:31.803608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d7a6a1e4-86f4-419b-a971-4d813fead37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:31.805961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 840/1743] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:31 2022] DELETE /identity/v3/projects/28aec5b111624af3a061ce7fd1a03b32 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:31.811191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b1b5-06cb-4d3d-b30c-7f578476a807 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:31.811742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b1b5-06cb-4d3d-b30c-7f578476a807 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:31.811834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b1b5-06cb-4d3d-b30c-7f578476a807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:31.851968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-90e6b1b5-06cb-4d3d-b30c-7f578476a807 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:31.852775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-90e6b1b5-06cb-4d3d-b30c-7f578476a807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:32.025014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 904/1744] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:32.026441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2afcec-22bf-4b6b-993a-eeebabe5bb6f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.026900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2afcec-22bf-4b6b-993a-eeebabe5bb6f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.027120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2afcec-22bf-4b6b-993a-eeebabe5bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.057904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5b2afcec-22bf-4b6b-993a-eeebabe5bb6f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:32.059113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5b2afcec-22bf-4b6b-993a-eeebabe5bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:32.072206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 841/1745] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:32.077301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6b1b5-06cb-4d3d-b30c-7f578476a807 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:32.106443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6b1b5-06cb-4d3d-b30c-7f578476a807 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:32.127458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:32.128973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.130899 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.131481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.134907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:32.135393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:32.142578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:32.170089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 905/1746] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:46:32.180615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2afcec-22bf-4b6b-993a-eeebabe5bb6f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:32.194571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2afcec-22bf-4b6b-993a-eeebabe5bb6f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:32.209560 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:32.210626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.211148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.211576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.212736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:32.219730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:32.262170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 842/1747] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:32 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:32.266772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:32.283932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51370150-5c48-4274-a4aa-fb907e9419c0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:32.407140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:32.408436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.408824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.409373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.410909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:32.414221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:32.460772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 906/1748] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:32 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:32.467206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:32.482687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74f20b-c0a1-4a7e-b131-0c1195b616e8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:32.495390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:32.496021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.496308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.496592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.497344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:32.499008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:32.541470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:32.544107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 843/1749] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:32.556621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069924c6-952c-4a22-b8ef-424dd342cb8e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:32.562198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02a24-0452-48de-a56f-f72d91bac02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:32.563421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02a24-0452-48de-a56f-f72d91bac02e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.563797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02a24-0452-48de-a56f-f72d91bac02e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.564933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02a24-0452-48de-a56f-f72d91bac02e admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.565766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02a24-0452-48de-a56f-f72d91bac02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:32.567883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02a24-0452-48de-a56f-f72d91bac02e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:32.589620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 907/1750] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:32.590896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:32.600342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:32.608268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6b0ff-c78f-4e8e-898b-28537828cd2d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:32.621048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:32.622654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.623132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.623655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] PATH_INFO: `/v3/projects/d54c48462acb49f58a58ce1d6d29c2b9/users/d7ba45e0f6594dbaa5f14d76ba91e077/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.650816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54c48462acb49f58a58ce1d6d29c2b9, user_id=d7ba45e0f6594dbaa5f14d76ba91e077, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:32.656271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:32.694988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 844/1751] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:32 2022] PUT /identity/v3/projects/d54c48462acb49f58a58ce1d6d29c2b9/users/d7ba45e0f6594dbaa5f14d76ba91e077/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:32.704223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a6af-ecea-47ab-be5e-c2db43977d30 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:32.704528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a6af-ecea-47ab-be5e-c2db43977d30 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:32.704848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a6af-ecea-47ab-be5e-c2db43977d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:32.779752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-eb32a6af-ecea-47ab-be5e-c2db43977d30 None None] MFA Rules not processed for user `d7ba45e0f6594dbaa5f14d76ba91e077`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:32.784634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-eb32a6af-ecea-47ab-be5e-c2db43977d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:32.828482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:32.831136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:32.896061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:32.936721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 908/1752] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:32.941391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a6af-ecea-47ab-be5e-c2db43977d30 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:33.058173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a76e1-165b-4384-8a12-80b22341805d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.071430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:33.074457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.074753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.075072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] PATH_INFO: `/v3/projects/01e2b95296f749b1ae84468756e974bd` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.076558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e2b95296f749b1ae84468756e974bd)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:33.079544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:33.134937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a6af-ecea-47ab-be5e-c2db43977d30 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.148155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:33.148860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.149153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.149440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.151636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:33.154933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:33.277160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e2b95296f749b1ae84468756e974bd', 'request_id': 'req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:33.295816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 909/1753] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:32 2022] POST /identity/v3/projects => generated 365 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:33.304661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:33.305028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e2b95296f749b1ae84468756e974bd', 'request_id': 'req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:33.328135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e2b95296f749b1ae84468756e974bd', 'request_id': 'req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:33.385452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] The token cache is being invalidate because project 01e2b95296f749b1ae84468756e974bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:33.389888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:33.391429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b6c9cd3f-d710-42a0-8ee7-42459ad008fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:33.396953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 845/1754] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:32 2022] DELETE /identity/v3/projects/01e2b95296f749b1ae84468756e974bd => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:33.401664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921144-08e2-4ab0-9df3-d121193c2fdd None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.401968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921144-08e2-4ab0-9df3-d121193c2fdd None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.402255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921144-08e2-4ab0-9df3-d121193c2fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.464117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-dd921144-08e2-4ab0-9df3-d121193c2fdd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:33.465782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dd921144-08e2-4ab0-9df3-d121193c2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:33.528617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceb9f3-882b-48e4-a8f2-8ead52f06158 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.539344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:33.540599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.541139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.541571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.542625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:33.545479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:33.574746 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 910/1755] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:33 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:33.580551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:33.586163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:33.600812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 846/1756] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:33.610278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59145e-d1e2-493f-b756-ad23d71aa720 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.610595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59145e-d1e2-493f-b756-ad23d71aa720 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.610907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59145e-d1e2-493f-b756-ad23d71aa720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.614172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f260b35-487b-4775-8029-fc8d9e7069fb admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.634245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:33.635400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.635902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.636383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.637354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:33.639240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:33.656061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5e59145e-d1e2-493f-b756-ad23d71aa720 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:33.659979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5e59145e-d1e2-493f-b756-ad23d71aa720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:33.672021 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 911/1757] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:33.673325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:33.697923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 847/1758] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:33.703670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de39be-8969-4d5e-bc5c-91270d60be7c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.703863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59145e-d1e2-493f-b756-ad23d71aa720 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:33.715683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:33.715885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:33.715964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.715964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.715964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] PATH_INFO: `/v3/projects/41c0932b01d14e63b768aeb4ab8bf64c/users/433f060044374fb2a040994a456ed9c5/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.719167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59145e-d1e2-493f-b756-ad23d71aa720 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.738774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:33.739562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.740065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.740465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:33.741830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:33.742151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:33.743894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:33.754471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c0932b01d14e63b768aeb4ab8bf64c, user_id=433f060044374fb2a040994a456ed9c5, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:33.757514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:33.775451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 848/1759] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:46:33.776380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:33.781610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 912/1760] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:33 2022] PUT /identity/v3/projects/41c0932b01d14e63b768aeb4ab8bf64c/users/433f060044374fb2a040994a456ed9c5/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:33.785465 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:33.805754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446b755-00e3-4443-a1a8-f057ad2fd351 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.894501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:33.982978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9713185-0459-44a4-9533-c9559a7f4147 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:33.997304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:33.998021 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:33.998319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:33.998606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.001573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:34.005623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:34.030200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 913/1761] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:34.034115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:34.065811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec194-dc02-48fd-adb6-00e81e7cdd41 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:34.081074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38624f12-6602-4737-8963-062a87b2e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:34.082025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38624f12-6602-4737-8963-062a87b2e47a admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.082314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38624f12-6602-4737-8963-062a87b2e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.082600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38624f12-6602-4737-8963-062a87b2e47a admin admin] PATH_INFO: `/v3/projects/41c0932b01d14e63b768aeb4ab8bf64c/users/433f060044374fb2a040994a456ed9c5/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.087334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38624f12-6602-4737-8963-062a87b2e47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c0932b01d14e63b768aeb4ab8bf64c, user_id=433f060044374fb2a040994a456ed9c5, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:34.090523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38624f12-6602-4737-8963-062a87b2e47a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:34.139202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 914/1762] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:34 2022] PUT /identity/v3/projects/41c0932b01d14e63b768aeb4ab8bf64c/users/433f060044374fb2a040994a456ed9c5/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:34.149430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96989fb-9380-4050-95d7-d00be9733945 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.149740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96989fb-9380-4050-95d7-d00be9733945 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.150085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96989fb-9380-4050-95d7-d00be9733945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.219532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f96989fb-9380-4050-95d7-d00be9733945 None None] MFA Rules not processed for user `433f060044374fb2a040994a456ed9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:34.221564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f96989fb-9380-4050-95d7-d00be9733945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:34.315802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae34f7-ab81-4ff6-aa41-60ba9253439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:34.316554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae34f7-ab81-4ff6-aa41-60ba9253439d admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.317016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae34f7-ab81-4ff6-aa41-60ba9253439d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.317261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae34f7-ab81-4ff6-aa41-60ba9253439d admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.318152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae34f7-ab81-4ff6-aa41-60ba9253439d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:34.320146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae34f7-ab81-4ff6-aa41-60ba9253439d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:34.407697 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 849/1763] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:33 2022] POST /identity/v3/projects => generated 373 bytes in 632 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:34.424332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205017-56a2-42fc-929c-6ce8aaac3ca0 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.425849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205017-56a2-42fc-929c-6ce8aaac3ca0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.426239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205017-56a2-42fc-929c-6ce8aaac3ca0 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.432232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 850/1764] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:46:34 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:34.434279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205017-56a2-42fc-929c-6ce8aaac3ca0 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:34.547708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 915/1765] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:34.560062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef711fa-8a61-4deb-b951-0297c5a9173b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.560317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef711fa-8a61-4deb-b951-0297c5a9173b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.560649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef711fa-8a61-4deb-b951-0297c5a9173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.590024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205017-56a2-42fc-929c-6ce8aaac3ca0 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:34.606417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:34.610405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.612551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.613424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.614056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:34.615965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2ef711fa-8a61-4deb-b951-0297c5a9173b None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:34.616908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:34.617225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2ef711fa-8a61-4deb-b951-0297c5a9173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:34.655308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 851/1766] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:34 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:34.656142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:34.658977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:34.751340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49372-ceb4-4c5b-bd00-56c68e6aa25d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:34.762779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:34.763588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.763969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.764506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.764914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 916/1767] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:46:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:34.769203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef711fa-8a61-4deb-b951-0297c5a9173b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:34.792965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef711fa-8a61-4deb-b951-0297c5a9173b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:34.808776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:34.809733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.810387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.811965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.814054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:34.816391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:34.830551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 917/1768] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:34.834718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:34.850057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345930a2-5700-430d-9273-5a6e03753e22 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:34.857916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:34.858840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.859275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.859773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.860870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:34.865410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:34.869881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:34.887662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 918/1769] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:34.892623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:34.917015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44a5b1-b368-4409-9b2c-e6d167acd330 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:34.929653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a809086-e01b-436f-8e1d-8d424cdf43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:34.931992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a809086-e01b-436f-8e1d-8d424cdf43a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:34.939118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a809086-e01b-436f-8e1d-8d424cdf43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:34.940013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a809086-e01b-436f-8e1d-8d424cdf43a8 admin admin] PATH_INFO: `/v3/projects/a3d8e8f679fe42bd9d9ac066c89efe58/users/aa45925885434f71b04c5ce4357d045f/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:34.954654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:34.989034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a809086-e01b-436f-8e1d-8d424cdf43a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d8e8f679fe42bd9d9ac066c89efe58, user_id=aa45925885434f71b04c5ce4357d045f, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:34.994345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a809086-e01b-436f-8e1d-8d424cdf43a8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:35.008588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:35.012634 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:35.026755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 852/1770] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:35.028167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:35.031831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:35.053301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 919/1771] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:34 2022] PUT /identity/v3/projects/a3d8e8f679fe42bd9d9ac066c89efe58/users/aa45925885434f71b04c5ce4357d045f/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:35.055258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f473d-4afb-408a-bb7e-52c2059f3bcc None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:35.055575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f473d-4afb-408a-bb7e-52c2059f3bcc None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:35.055931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f473d-4afb-408a-bb7e-52c2059f3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:35.115030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d1c58-ea75-4ee0-8ae4-6289bd8f3705 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:35.126380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6d5f473d-4afb-408a-bb7e-52c2059f3bcc None None] MFA Rules not processed for user `aa45925885434f71b04c5ce4357d045f`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:35.133131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6d5f473d-4afb-408a-bb7e-52c2059f3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:35.317488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:35.319467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:35.319761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:35.322696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:35.340716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 920/1772] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:35.343112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f473d-4afb-408a-bb7e-52c2059f3bcc None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:35.378362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:35.380632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:35.444486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 853/1773] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:35.445475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:35.454458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:35.525320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f473d-4afb-408a-bb7e-52c2059f3bcc None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:35.547805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:35.550358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:35.552423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:35.552834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:35.558337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:35.701095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:35.707075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:35.710099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4936-b59b-4b51-88ed-e8d503c7170d service nova] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:35.728856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 921/1774] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:35.729492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:35.731129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:35.739618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:35.740550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:35.740842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:35.741127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] PATH_INFO: `/v3/projects/f9a4b324d067485584baff9169b34972` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:35.742402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a4b324d067485584baff9169b34972)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:35.743778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfa6bc-158a-4837-b1b3-1c97f3dbf489 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:35.744439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:35.748432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092faa10-1532-4c67-8522-8597170bab68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:35.749524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092faa10-1532-4c67-8522-8597170bab68 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:35.750027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092faa10-1532-4c67-8522-8597170bab68 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:35.750420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092faa10-1532-4c67-8522-8597170bab68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:35.760872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092faa10-1532-4c67-8522-8597170bab68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:35.762475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092faa10-1532-4c67-8522-8597170bab68 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:35.787915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 922/1775] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:35.885979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:35.931710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a4b324d067485584baff9169b34972', 'request_id': 'req-16af92a3-b6c2-4812-ba35-6c019f7460d0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:35.948970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a4b324d067485584baff9169b34972', 'request_id': 'req-16af92a3-b6c2-4812-ba35-6c019f7460d0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:35.970348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a4b324d067485584baff9169b34972', 'request_id': 'req-16af92a3-b6c2-4812-ba35-6c019f7460d0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:35.997109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] The token cache is being invalidate because project f9a4b324d067485584baff9169b34972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:35.997421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:35.999690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-16af92a3-b6c2-4812-ba35-6c019f7460d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:36.010966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 854/1776] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:35 2022] DELETE /identity/v3/projects/f9a4b324d067485584baff9169b34972 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:36.015921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aa4b9-5081-4164-971a-702e5e0a614a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:36.016382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aa4b9-5081-4164-971a-702e5e0a614a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:36.016699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aa4b9-5081-4164-971a-702e5e0a614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:36.072634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-135aa4b9-5081-4164-971a-702e5e0a614a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:36.074488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-135aa4b9-5081-4164-971a-702e5e0a614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:36.118376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:36.298232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 923/1777] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:36.306387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3b5a7-e631-47fc-8da9-0110d43b18f1 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:36.307090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3b5a7-e631-47fc-8da9-0110d43b18f1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:36.308241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3b5a7-e631-47fc-8da9-0110d43b18f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:36.342648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-23d3b5a7-e631-47fc-8da9-0110d43b18f1 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:36.344091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-23d3b5a7-e631-47fc-8da9-0110d43b18f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:36.353933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 855/1778] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:36.357958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aa4b9-5081-4164-971a-702e5e0a614a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:36.370002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aa4b9-5081-4164-971a-702e5e0a614a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:36.375545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:36.376507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:36.377556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:36.414144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:36.415286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:36.420723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:36.422660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:36.471020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3b5a7-e631-47fc-8da9-0110d43b18f1 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:36.484379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 924/1779] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:46:36.493623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3b5a7-e631-47fc-8da9-0110d43b18f1 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:36.518617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:36.519624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:36.520027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:36.520957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:36.521670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:36.530549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:36.638279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 856/1780] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:36 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:36.643666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:36.675531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4f027-174f-4744-8556-99cf33ba52e0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:36.862072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:36.871288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:36.871288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:36.871288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:36.871288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:36.871288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:36.908317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:36.924326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 925/1781] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:36 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:36.926975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc8a-3c5a-4a68-b24b-db8b7f352f9a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:36.933318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:36.934347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:36.934754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:36.935228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:36.936112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:36.943497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:36.956635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 857/1782] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:46:36.961198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:36.978574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65f64-6f5b-4cdf-b299-044fe67f3310 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:36.984931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78fc89-7c70-4d2b-aa98-f202edd7c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:36.987600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78fc89-7c70-4d2b-aa98-f202edd7c9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:36.988059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78fc89-7c70-4d2b-aa98-f202edd7c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:37.001246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78fc89-7c70-4d2b-aa98-f202edd7c9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:37.002453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78fc89-7c70-4d2b-aa98-f202edd7c9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:37.004383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78fc89-7c70-4d2b-aa98-f202edd7c9d1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:37.030670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 926/1783] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:37.035112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:37.058001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49108a0-0381-4f5b-8fa0-ede6ba6dbc0e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:37.086821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:37.087833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:37.088228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:37.088690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] PATH_INFO: `/v3/projects/47ec49c30c2b4720a0a25351e253bb55/users/e78f681e47f74bafa91d841b80efd862/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:37.116270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ec49c30c2b4720a0a25351e253bb55, user_id=e78f681e47f74bafa91d841b80efd862, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:37.126473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:37.184232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 858/1784] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:37 2022] PUT /identity/v3/projects/47ec49c30c2b4720a0a25351e253bb55/users/e78f681e47f74bafa91d841b80efd862/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:37.193568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d5aa-17a9-4310-9d38-84aacc81463e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:37.193869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d5aa-17a9-4310-9d38-84aacc81463e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:37.194208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d5aa-17a9-4310-9d38-84aacc81463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:37.273305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fca9d5aa-17a9-4310-9d38-84aacc81463e None None] MFA Rules not processed for user `e78f681e47f74bafa91d841b80efd862`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:37.276419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fca9d5aa-17a9-4310-9d38-84aacc81463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:37.448114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 927/1785] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:37.449881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:37.581039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c682f-b7b8-495f-9ccf-60de703d971d None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:37.582691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c682f-b7b8-495f-9ccf-60de703d971d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:37.583013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c682f-b7b8-495f-9ccf-60de703d971d None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:37.585107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 928/1786] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:46:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 18:46:37.596093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca78be8-3e6d-4e9b-9c2c-1e4ac6d6225f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:37.596396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca78be8-3e6d-4e9b-9c2c-1e4ac6d6225f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:37.596675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca78be8-3e6d-4e9b-9c2c-1e4ac6d6225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:37.635065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb19e-0c5f-44af-8381-51e154de0107 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:37.640080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:37.640977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:37.641328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:37.641722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:37.642824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:37.645389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:37.664852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-eca78be8-3e6d-4e9b-9c2c-1e4ac6d6225f None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:37.668424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-eca78be8-3e6d-4e9b-9c2c-1e4ac6d6225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:37.685031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 859/1787] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:37 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:37.686150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:37.693086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:37.897417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 929/1788] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:37.902359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:37.945754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc55460-e3c1-4ccc-8893-1fdab21911ae admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:37.959802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:37.960799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:37.961192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:37.961708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:37.962689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:37.979739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:38.054810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 860/1789] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:37 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:38.058624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca78be8-3e6d-4e9b-9c2c-1e4ac6d6225f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:38.074846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca78be8-3e6d-4e9b-9c2c-1e4ac6d6225f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:38.098445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:38.099127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:38.099615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:38.099775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:38.101153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:38.104688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:38.147742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 930/1790] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:38.150768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:38.176091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b59fd-1431-48d1-9e11-673ceb3ec6bd admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:38.188669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:38.190778 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:38.195397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:38.197053 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:38.198344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:38.201173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:38.217388 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:38.218555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 861/1791] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:38.224082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:38.224292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:38.270416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1adb18-9561-4b40-96d0-511b815554bd admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:38.289017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28577-da23-4982-9e70-82899570ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:38.289838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28577-da23-4982-9e70-82899570ad7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:38.292314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28577-da23-4982-9e70-82899570ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:38.292624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28577-da23-4982-9e70-82899570ad7d admin admin] PATH_INFO: `/v3/projects/1ae369873c5446d293fb5bf2c05c7f8f/users/d5bfb79aab494cdab2c4c37d280dd3e2/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:38.349816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28577-da23-4982-9e70-82899570ad7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae369873c5446d293fb5bf2c05c7f8f, user_id=d5bfb79aab494cdab2c4c37d280dd3e2, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:38.353960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28577-da23-4982-9e70-82899570ad7d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:38.374861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5dd22-e914-42ea-88fa-579da3cf941e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:38.378610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 862/1792] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:38 2022] PUT /identity/v3/projects/1ae369873c5446d293fb5bf2c05c7f8f/users/d5bfb79aab494cdab2c4c37d280dd3e2/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:38.393151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee5d5-3e0b-4c7d-9943-7c0fae43c1a3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:38.393453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee5d5-3e0b-4c7d-9943-7c0fae43c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:38.393877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee5d5-3e0b-4c7d-9943-7c0fae43c1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:38.461404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1beee5d5-3e0b-4c7d-9943-7c0fae43c1a3 None None] MFA Rules not processed for user `d5bfb79aab494cdab2c4c37d280dd3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:38.462592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1beee5d5-3e0b-4c7d-9943-7c0fae43c1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:38.544954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:38.546985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:38.548832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:38.551531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:38.615077 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:38.616924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:38.633438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 863/1793] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:38.637979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee5d5-3e0b-4c7d-9943-7c0fae43c1a3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:38.650153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 931/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:38.798851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee5d5-3e0b-4c7d-9943-7c0fae43c1a3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:38.814810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:38.815701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:38.816006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:38.816367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:38.817105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:38.829813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:38.922599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 864/1795] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:38 2022] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:38.927721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:38.949414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c5073-01cd-49f0-8d3d-10103d217db1 service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:38.977176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:39.095384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:39.100777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:39.101086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:39.101380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:39.102106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:39.110624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:39.164080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 932/1796] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:38 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:39.167810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:39.209774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa697aa6-da6a-4abb-8b92-bccdec41c49d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:39.221291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:39.222446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:39.222761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:39.223136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:39.223968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:39.225813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:39.242820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 865/1797] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:46:39.244286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:39.257918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27c4d-1cce-491b-a8eb-b125d6a7692e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:39.263373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:39.264292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:39.264851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:39.265183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] PATH_INFO: `/v3/projects/ef6f153c71c44592ba9b85a97121df90/users/2ffdf75fdf6d4ea59d8d47ce115a2736/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:39.329028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6f153c71c44592ba9b85a97121df90, user_id=2ffdf75fdf6d4ea59d8d47ce115a2736, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:39.335362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:39.367513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 933/1798] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:39 2022] PUT /identity/v3/projects/ef6f153c71c44592ba9b85a97121df90/users/2ffdf75fdf6d4ea59d8d47ce115a2736/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:39.372318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:39.388738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8571a1-61a8-4c13-acdd-c9e82e47eee8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:39.403271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:39.472372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6ad18-c9fa-408f-ac49-4125b444192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:39.473084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6ad18-c9fa-408f-ac49-4125b444192b admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:39.473371 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6ad18-c9fa-408f-ac49-4125b444192b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:39.473767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6ad18-c9fa-408f-ac49-4125b444192b admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:39.474680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6ad18-c9fa-408f-ac49-4125b444192b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:39.476923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6ad18-c9fa-408f-ac49-4125b444192b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:39.503589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 866/1799] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:39.505540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:39.521269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb204a50-0926-4d11-8657-ed3286275db7 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:39.535806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:39.537144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:39.537516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:39.537863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] PATH_INFO: `/v3/projects/ef6f153c71c44592ba9b85a97121df90/users/2ffdf75fdf6d4ea59d8d47ce115a2736/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:39.544327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6f153c71c44592ba9b85a97121df90, user_id=2ffdf75fdf6d4ea59d8d47ce115a2736, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:39.553408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:39.598614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 934/1800] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:39 2022] PUT /identity/v3/projects/ef6f153c71c44592ba9b85a97121df90/users/2ffdf75fdf6d4ea59d8d47ce115a2736/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:39.610039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9c37-d80d-47be-889f-e5adde1f6aca None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:39.610364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9c37-d80d-47be-889f-e5adde1f6aca None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:39.610710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9c37-d80d-47be-889f-e5adde1f6aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:39.680195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1c7b9c37-d80d-47be-889f-e5adde1f6aca None None] MFA Rules not processed for user `2ffdf75fdf6d4ea59d8d47ce115a2736`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:39.681459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1c7b9c37-d80d-47be-889f-e5adde1f6aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:39.847993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 867/1801] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:39.871657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:39.873484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:39.972896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279931-c835-4bd8-89d7-8aa73593f3f3 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:39.977722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:39.978482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:39.978835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:39.979213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:39.995326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:39.995326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:40.005620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 935/1802] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:40.978672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9c37-d80d-47be-889f-e5adde1f6aca None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:40.988506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9c37-d80d-47be-889f-e5adde1f6aca None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:40.992360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399206-49c5-4122-bd52-52fb446edbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:40.993148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399206-49c5-4122-bd52-52fb446edbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:40.993542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399206-49c5-4122-bd52-52fb446edbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:40.993929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399206-49c5-4122-bd52-52fb446edbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:41.061780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399206-49c5-4122-bd52-52fb446edbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:41.063669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399206-49c5-4122-bd52-52fb446edbc8 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:41.073540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 868/1803] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:41.176954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:41.178564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:41.256982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccad525-477f-40c7-862c-9a01815b6686 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:41.262310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:41.263502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:41.263983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:41.264435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] PATH_INFO: `/v3/users/aa45925885434f71b04c5ce4357d045f` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:41.265888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa45925885434f71b04c5ce4357d045f)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:41.268679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:41.286305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:41.337255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa45925885434f71b04c5ce4357d045f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:41.349708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa45925885434f71b04c5ce4357d045f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:41.350509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa45925885434f71b04c5ce4357d045f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:41.366193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa45925885434f71b04c5ce4357d045f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:41.413353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa45925885434f71b04c5ce4357d045f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:41.431018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 936/1804] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:41 2022] DELETE /identity/v3/users/aa45925885434f71b04c5ce4357d045f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:41.434253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:41.434645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:41.435232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:41.474364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:41.475838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:41.513544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:41.560991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 869/1805] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:41.574278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:41.576886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:41.661224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74b1d-003c-428f-8a9a-a9a39ad43185 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:41.665816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc124d-60c6-45b3-b5a5-a758f2f7aede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:41.666480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc124d-60c6-45b3-b5a5-a758f2f7aede service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:41.666805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc124d-60c6-45b3-b5a5-a758f2f7aede service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:41.667130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc124d-60c6-45b3-b5a5-a758f2f7aede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:41.676813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc124d-60c6-45b3-b5a5-a758f2f7aede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:41.678256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc124d-60c6-45b3-b5a5-a758f2f7aede service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:41.687904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 937/1806] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:41.984299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:41.986107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.005938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850056-ca1a-496f-b142-3c2e963f6cc3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.017316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.018216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.018898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.020052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] PATH_INFO: `/v3/projects/a3d8e8f679fe42bd9d9ac066c89efe58` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.021515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d8e8f679fe42bd9d9ac066c89efe58)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.023904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.101788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d8e8f679fe42bd9d9ac066c89efe58', 'request_id': 'req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.113323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d8e8f679fe42bd9d9ac066c89efe58', 'request_id': 'req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.120866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d8e8f679fe42bd9d9ac066c89efe58', 'request_id': 'req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.143078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] The token cache is being invalidate because project a3d8e8f679fe42bd9d9ac066c89efe58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:42.143380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.144622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b80ea819-c434-47ad-b264-1a0b3a7a9dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.148236 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 870/1807] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:41 2022] DELETE /identity/v3/projects/a3d8e8f679fe42bd9d9ac066c89efe58 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:42.151478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b494-a9cd-49de-891b-afba90a25b14 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.151778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b494-a9cd-49de-891b-afba90a25b14 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.152278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b494-a9cd-49de-891b-afba90a25b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.195119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a9b0b494-a9cd-49de-891b-afba90a25b14 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:42.196415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a9b0b494-a9cd-49de-891b-afba90a25b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.287226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 938/1808] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:42.295221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.295511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.296265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.316469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:42.317679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.327570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 871/1809] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:42.331774 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0b494-a9cd-49de-891b-afba90a25b14 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.343129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0b494-a9cd-49de-891b-afba90a25b14 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.348664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.349231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.349484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.349853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.350276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.350780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.351059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:42.351381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.353279 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.365853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf8caf-6d78-4693-973e-c09e199b922a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.371049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.371515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 939/1810] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:46:42.371772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.372055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.372340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] PATH_INFO: `/v3/users/d7ba45e0f6594dbaa5f14d76ba91e077` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.372503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.373622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ba45e0f6594dbaa5f14d76ba91e077)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.375712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.390628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e2dc4-7a97-42ad-8c4e-88b9aeb2c772 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.396617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.397380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.397731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.398020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.398731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.400716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.433077 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:42.437391 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ba45e0f6594dbaa5f14d76ba91e077'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.442964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 940/1811] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:42 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:42.445455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.447830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ba45e0f6594dbaa5f14d76ba91e077'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.455719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ba45e0f6594dbaa5f14d76ba91e077'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.456419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ba45e0f6594dbaa5f14d76ba91e077'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.457188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7e7f93ce-5f70-4921-8d07-1374dcb2dea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ba45e0f6594dbaa5f14d76ba91e077'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:42.476138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 872/1812] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:42 2022] DELETE /identity/v3/users/d7ba45e0f6594dbaa5f14d76ba91e077 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:42.480105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.480402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.480686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.502789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:42.504131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.514100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eaa17-6def-499f-8bd4-3b69455234a6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.519926 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:42.574148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 873/1813] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:42.583598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.584916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.586693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.587561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.587865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.588150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.588888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.591062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.615623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 941/1814] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:42 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:42.620099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.622606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.635296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0deff-bc9b-49be-8135-5721b97234d6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.641294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.642185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.642497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.642769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.643691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.645429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.655573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72dc52-98ab-44c2-8d7f-48aec1f1306d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.658963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 942/1815] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:46:42.661523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.665091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.665767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.666058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.666342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.680175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.683441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3849-dc95-49bd-bd44-c7c801199bed admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.688566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45625c-bb35-4bac-b6e5-4955cb37089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.689449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45625c-bb35-4bac-b6e5-4955cb37089d admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.689945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45625c-bb35-4bac-b6e5-4955cb37089d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.690303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45625c-bb35-4bac-b6e5-4955cb37089d admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.690894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.691634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45625c-bb35-4bac-b6e5-4955cb37089d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.694294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45625c-bb35-4bac-b6e5-4955cb37089d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.704857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 874/1816] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:46:42.728036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 943/1817] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:46:42.732117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.743958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce682-c1e2-4cb3-9984-7374b692465e service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.749443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.750479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.751072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.751375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] PATH_INFO: `/v3/projects/74d316cb5e62493396c570a9d455dc62/users/e469f50aeafc4e7db14b6585b004836a/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.772884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d316cb5e62493396c570a9d455dc62, user_id=e469f50aeafc4e7db14b6585b004836a, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:42.775633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:42.790965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 875/1818] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:42 2022] PUT /identity/v3/projects/74d316cb5e62493396c570a9d455dc62/users/e469f50aeafc4e7db14b6585b004836a/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:42.804028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e71e7-1669-49de-9456-1fc8265a2d01 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.804028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e71e7-1669-49de-9456-1fc8265a2d01 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.804319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e71e7-1669-49de-9456-1fc8265a2d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:42.836585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-497e71e7-1669-49de-9456-1fc8265a2d01 None None] MFA Rules not processed for user `e469f50aeafc4e7db14b6585b004836a`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:42.837921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-497e71e7-1669-49de-9456-1fc8265a2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:42.916954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 944/1819] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:42.921450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:42.993830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9aad0-3d81-4148-af8b-326d46f86673 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:42.998626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:42.999332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:42.999622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:42.999907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.000609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.002591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.028547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 876/1820] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:42 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:43.032635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e71e7-1669-49de-9456-1fc8265a2d01 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.039108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:43.045903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e71e7-1669-49de-9456-1fc8265a2d01 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.078945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.081426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:43.107389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.110144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.110264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:43.110353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.110424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.111523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.114134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.135412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 945/1821] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:43 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:43.139713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.149715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8e6f-fc37-4207-a7ab-8cbd2e6953fd admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.153021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997c0e5-b6ce-412b-996d-20a9f6861449 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.154226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.154884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.155197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.155485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.156233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.157866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.158118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.159075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.159536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.159826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] PATH_INFO: `/v3/projects/d54c48462acb49f58a58ce1d6d29c2b9` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.161023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54c48462acb49f58a58ce1d6d29c2b9)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.163235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.168679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 946/1822] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:46:43.173526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.183751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea118-d7c0-40dc-bd6a-485700515de1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.188870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.190148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.190800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.191158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.191898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.193481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.206035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 947/1823] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:43.210541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.221198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54c48462acb49f58a58ce1d6d29c2b9', 'request_id': 'req-453cbbe6-7103-4ef4-8cca-f45a23073ad6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.221359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b6c36-eb87-4b55-b0d9-f6986b402382 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.235964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54c48462acb49f58a58ce1d6d29c2b9', 'request_id': 'req-453cbbe6-7103-4ef4-8cca-f45a23073ad6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.244231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54c48462acb49f58a58ce1d6d29c2b9', 'request_id': 'req-453cbbe6-7103-4ef4-8cca-f45a23073ad6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.257256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] The token cache is being invalidate because project d54c48462acb49f58a58ce1d6d29c2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:43.257609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.258237 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.259927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 877/1824] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:43 2022] DELETE /identity/v3/projects/d54c48462acb49f58a58ce1d6d29c2b9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:43.263673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.265111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:43.300916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36549fd-7ed1-48b9-bd52-6088783efad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.302238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36549fd-7ed1-48b9-bd52-6088783efad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.302672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36549fd-7ed1-48b9-bd52-6088783efad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.303195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36549fd-7ed1-48b9-bd52-6088783efad2 admin admin] PATH_INFO: `/v3/projects/1cc40246a5a646d184fad86c6f35da1e/users/c361d8d893fb476ab78864456fe98155/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.321107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36549fd-7ed1-48b9-bd52-6088783efad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc40246a5a646d184fad86c6f35da1e, user_id=c361d8d893fb476ab78864456fe98155, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.324373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36549fd-7ed1-48b9-bd52-6088783efad2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.343318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 948/1825] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:43 2022] PUT /identity/v3/projects/1cc40246a5a646d184fad86c6f35da1e/users/c361d8d893fb476ab78864456fe98155/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:43.355534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.356013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.356581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.357237 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cbbe6-7103-4ef4-8cca-f45a23073ad6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.393562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] MFA Rules not processed for user `c361d8d893fb476ab78864456fe98155`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:43.395601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:43.430399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.431388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.431685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.431966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] PATH_INFO: `/v3/users/433f060044374fb2a040994a456ed9c5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.433214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433f060044374fb2a040994a456ed9c5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.435177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.438052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:43.457480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:43.483275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 949/1826] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:43.487761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.489029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:43.489623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433f060044374fb2a040994a456ed9c5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.497698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433f060044374fb2a040994a456ed9c5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.502801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e0b4-b132-4fd0-a5b4-c1cef95113da None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.507560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.507716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433f060044374fb2a040994a456ed9c5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.508253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.508388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433f060044374fb2a040994a456ed9c5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.508555 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.508806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.509063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433f060044374fb2a040994a456ed9c5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.509506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.511445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.526862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 878/1827] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:43 2022] DELETE /identity/v3/users/433f060044374fb2a040994a456ed9c5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:43.537867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 950/1828] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:43 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:43.541801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.543302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:43.609156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f2c3-a1a0-4b8c-b5a7-fd6c8eced500 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.668858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.669682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.670122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.670434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.671272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.673884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.702054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 879/1829] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:43 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:43.705779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.716657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c889-2613-4080-8d81-562160f77a7e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.722048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.722888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.723338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.723717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.724938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.726775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.742362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 951/1830] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:43.743643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.754782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15d9b-7ae3-4772-a6c4-405d6d96c65f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.760385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.761541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.762039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.762530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] PATH_INFO: `/v3/projects/f9cf0d5204094168a5c68fa9b17113f9/users/0cab15bee284438eb7cdb9be467b9dd9/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.783775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cf0d5204094168a5c68fa9b17113f9, user_id=0cab15bee284438eb7cdb9be467b9dd9, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.786622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.789265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:43.805349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 880/1831] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:43 2022] PUT /identity/v3/projects/f9cf0d5204094168a5c68fa9b17113f9/users/0cab15bee284438eb7cdb9be467b9dd9/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:43.809416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.817815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.820435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:43.822091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee016fb5-d285-43da-8f59-6bb4b923a736 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.891957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c2a44-fa72-4693-9cc8-7a70006f9b60 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.896670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.896846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.897356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.897647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.897745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.897929 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.898019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.898227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] PATH_INFO: `/v3/projects/41c0932b01d14e63b768aeb4ab8bf64c` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.898687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.899532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c0932b01d14e63b768aeb4ab8bf64c)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.900322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.901448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.910880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 952/1832] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:43.915234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:43.925063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320cb9-9d3b-40cc-9508-74f6f4c25d72 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:43.931001 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c7163-ec51-4d05-afef-0d0fd75b46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:43.931938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7163-ec51-4d05-afef-0d0fd75b46cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.932257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7163-ec51-4d05-afef-0d0fd75b46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.932666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c7163-ec51-4d05-afef-0d0fd75b46cd admin admin] PATH_INFO: `/v3/projects/f9cf0d5204094168a5c68fa9b17113f9/users/0cab15bee284438eb7cdb9be467b9dd9/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.934857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c7163-ec51-4d05-afef-0d0fd75b46cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cf0d5204094168a5c68fa9b17113f9, user_id=0cab15bee284438eb7cdb9be467b9dd9, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:43.937949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c7163-ec51-4d05-afef-0d0fd75b46cd admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:43.950033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 953/1833] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:43 2022] PUT /identity/v3/projects/f9cf0d5204094168a5c68fa9b17113f9/users/0cab15bee284438eb7cdb9be467b9dd9/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:43.960080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:43.960378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:43.960660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:43.974772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c0932b01d14e63b768aeb4ab8bf64c', 'request_id': 'req-358dcc98-b85a-45b0-8e59-a088804bcb56'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.990395 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c0932b01d14e63b768aeb4ab8bf64c', 'request_id': 'req-358dcc98-b85a-45b0-8e59-a088804bcb56'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.997252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] MFA Rules not processed for user `0cab15bee284438eb7cdb9be467b9dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:43.998090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c0932b01d14e63b768aeb4ab8bf64c', 'request_id': 'req-358dcc98-b85a-45b0-8e59-a088804bcb56'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:43.999821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:44.012848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] The token cache is being invalidate because project 41c0932b01d14e63b768aeb4ab8bf64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:44.013039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:44.013745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-358dcc98-b85a-45b0-8e59-a088804bcb56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:44.015359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 881/1834] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:43 2022] DELETE /identity/v3/projects/41c0932b01d14e63b768aeb4ab8bf64c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:44.023950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ee6c-5070-4e9b-be4a-c1ff852a3f20 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.024325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ee6c-5070-4e9b-be4a-c1ff852a3f20 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.024645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ee6c-5070-4e9b-be4a-c1ff852a3f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.047137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-08e7ee6c-5070-4e9b-be4a-c1ff852a3f20 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:44.049017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-08e7ee6c-5070-4e9b-be4a-c1ff852a3f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:44.104627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 954/1835] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:44.119968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.122707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:44.132049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 882/1836] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:44.140949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ff7d7-e1ec-4376-af43-1bfb2d9c36ad None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.141604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ff7d7-e1ec-4376-af43-1bfb2d9c36ad None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.141965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ff7d7-e1ec-4376-af43-1bfb2d9c36ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.149560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:44.161220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5a6ff7d7-e1ec-4376-af43-1bfb2d9c36ad None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:44.162760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5a6ff7d7-e1ec-4376-af43-1bfb2d9c36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:44.174571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 883/1837] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:44.178722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ff7d7-e1ec-4376-af43-1bfb2d9c36ad None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.187641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ff7d7-e1ec-4376-af43-1bfb2d9c36ad None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.192322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.192975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.193269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.193557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.194294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:44.194613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.196037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21097b1-8a72-4ea0-9261-431b1048780b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.196256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.199694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.200344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.200630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.200910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.203146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:44.207758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 884/1838] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:46:44.211885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.218032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:44.222033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfccaf-6b2a-4b8e-a9d5-77aa7ae3f964 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.227988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.228816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.229264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.229605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.230513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.232471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.258570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 885/1839] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:44 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:44.262610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.262778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.264335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.273724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 955/1840] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:46:44.327283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ca74c-c805-4a29-b974-a51b6dd37013 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.332219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.332894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.333184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.333467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.334164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.336114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.358667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 886/1841] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:44 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:44.363304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.374094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bdaa-8a1a-4fe4-abcb-183f3a8d36b4 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.379615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.380282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.380597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.380879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.381607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.383234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.395090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 956/1842] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:44.398879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.410988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29042d1c-d320-447e-87da-7678216bfbfb admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.418107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934ca45-7a8c-499e-9c8b-e9285202b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.418618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934ca45-7a8c-499e-9c8b-e9285202b540 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.419041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934ca45-7a8c-499e-9c8b-e9285202b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.419402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934ca45-7a8c-499e-9c8b-e9285202b540 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.420250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934ca45-7a8c-499e-9c8b-e9285202b540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.422214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934ca45-7a8c-499e-9c8b-e9285202b540 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.433641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 887/1843] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:44.438579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.451829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e785-74f7-4c1c-ad63-02c15e57ef72 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.460339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.461384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.461796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.461989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] PATH_INFO: `/v3/projects/854d805be930492fb9832720db023823/users/08ad143391584f1ca6dea2faef074d6b/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.483608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854d805be930492fb9832720db023823, user_id=08ad143391584f1ca6dea2faef074d6b, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.488002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.508225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 957/1844] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:44 2022] PUT /identity/v3/projects/854d805be930492fb9832720db023823/users/08ad143391584f1ca6dea2faef074d6b/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:44.518623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4465-da27-4b86-8c3d-9bd1060d6ccf None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.518986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4465-da27-4b86-8c3d-9bd1060d6ccf None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.519664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4465-da27-4b86-8c3d-9bd1060d6ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.555389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bd1d4465-da27-4b86-8c3d-9bd1060d6ccf None None] MFA Rules not processed for user `08ad143391584f1ca6dea2faef074d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:44.556859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bd1d4465-da27-4b86-8c3d-9bd1060d6ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:44.667562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 888/1845] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:44.672040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.741962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747cfa-8051-4795-b344-5121019db293 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.746549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.747255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.747544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.747825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.748514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.750445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.775368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 958/1846] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:44 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:44.780622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d4465-da27-4b86-8c3d-9bd1060d6ccf None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.792054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d4465-da27-4b86-8c3d-9bd1060d6ccf None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.855143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:44.865615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.866539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.866776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.867161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.868611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.870611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.914795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 889/1847] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:44 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:44.916095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.928377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99fee-e21f-49e3-8ca3-c08700c0f443 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.934690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.935417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.935714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.936002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.936747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.938408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:44.953988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 959/1848] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:44.955294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:44.966533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d240f0-cda6-4138-813f-8d9a2ea66f7c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:44.971927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:44.972851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:44.973144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:44.973433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] PATH_INFO: `/v3/projects/425a888ff3d6437ebbb3fdfd2c3ff2b5/users/4b908325c22e4cd2801f6a9360962755/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:44.990176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a888ff3d6437ebbb3fdfd2c3ff2b5, user_id=4b908325c22e4cd2801f6a9360962755, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:44.992987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:45.006771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 890/1849] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:44 2022] PUT /identity/v3/projects/425a888ff3d6437ebbb3fdfd2c3ff2b5/users/4b908325c22e4cd2801f6a9360962755/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:45.011100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:45.021384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce01b16-2a88-4811-a2a1-ca0e848636e1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:45.029004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:45.077309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac226bc-237a-4338-974e-628357170359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:45.077985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac226bc-237a-4338-974e-628357170359 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:45.078276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac226bc-237a-4338-974e-628357170359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:45.078560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac226bc-237a-4338-974e-628357170359 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:45.079322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac226bc-237a-4338-974e-628357170359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:45.081421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac226bc-237a-4338-974e-628357170359 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:45.090850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 960/1850] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:45.096048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:45.106354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd56911-9b7c-44ef-9337-312c9037c741 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:45.111540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:45.112432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:45.112721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:45.113002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] PATH_INFO: `/v3/projects/425a888ff3d6437ebbb3fdfd2c3ff2b5/users/4b908325c22e4cd2801f6a9360962755/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:45.114982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a888ff3d6437ebbb3fdfd2c3ff2b5, user_id=4b908325c22e4cd2801f6a9360962755, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:45.117940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:45.129140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 891/1851] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:45 2022] PUT /identity/v3/projects/425a888ff3d6437ebbb3fdfd2c3ff2b5/users/4b908325c22e4cd2801f6a9360962755/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:45.140988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72d9b-203d-4e47-8a54-62d36f251c92 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:45.141286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72d9b-203d-4e47-8a54-62d36f251c92 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:45.141596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72d9b-203d-4e47-8a54-62d36f251c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:45.169076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-cbc72d9b-203d-4e47-8a54-62d36f251c92 None None] MFA Rules not processed for user `4b908325c22e4cd2801f6a9360962755`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:45.170278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-cbc72d9b-203d-4e47-8a54-62d36f251c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:45.252492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 961/1852] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:45.264384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:45.267727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:45.337855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f7f3-16d8-496d-959b-215b8f6cc47e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:45.341500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e7a72-cd67-4c13-b733-9d64a603874a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:45.342162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7a72-cd67-4c13-b733-9d64a603874a service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:45.342452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7a72-cd67-4c13-b733-9d64a603874a service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:45.342742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7a72-cd67-4c13-b733-9d64a603874a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:45.352459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e7a72-cd67-4c13-b733-9d64a603874a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:45.353891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e7a72-cd67-4c13-b733-9d64a603874a service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:45.363251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 892/1853] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:45.791597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc72d9b-203d-4e47-8a54-62d36f251c92 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:45.985016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc72d9b-203d-4e47-8a54-62d36f251c92 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:45.989892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:45.990757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:45.991148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:45.991430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] PATH_INFO: `/v3/users/08ad143391584f1ca6dea2faef074d6b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:45.992590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ad143391584f1ca6dea2faef074d6b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:45.994487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:46.030639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:46.041198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ad143391584f1ca6dea2faef074d6b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.048836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ad143391584f1ca6dea2faef074d6b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.049455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ad143391584f1ca6dea2faef074d6b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.056339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ad143391584f1ca6dea2faef074d6b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.068493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ad143391584f1ca6dea2faef074d6b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.074248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 962/1854] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:45 2022] DELETE /identity/v3/users/08ad143391584f1ca6dea2faef074d6b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:46.078713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:46.079248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:46.079336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:46.095747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:46.097072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:46.153900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 893/1855] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:46.164006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:46.165421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:46.221484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae113-357d-46fe-8d9d-4bb00b4f8964 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:46.225049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:46.225690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:46.225981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:46.226255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:46.235014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:46.236463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:46.245638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 963/1856] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:46.610521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:46.612350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:46.625318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34067d2-08d8-46d7-87ba-0a7993b4154a None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:46.630838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:46.631755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:46.632044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:46.632330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] PATH_INFO: `/v3/projects/854d805be930492fb9832720db023823` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:46.633553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854d805be930492fb9832720db023823)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:46.635549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:46.679664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:46.686446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854d805be930492fb9832720db023823', 'request_id': 'req-ec87544e-4119-4f36-9b00-54ff08ac8700'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.695246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854d805be930492fb9832720db023823', 'request_id': 'req-ec87544e-4119-4f36-9b00-54ff08ac8700'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.710396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854d805be930492fb9832720db023823', 'request_id': 'req-ec87544e-4119-4f36-9b00-54ff08ac8700'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.722058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] The token cache is being invalidate because project 854d805be930492fb9832720db023823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:46.722350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.723039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.724603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 894/1857] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:46 2022] DELETE /identity/v3/projects/854d805be930492fb9832720db023823 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:46.728530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:46.737923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34764e0-9ad5-477e-8c9c-8cbe5145bd7d service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:46.792625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:46.793506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:46.793797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:46.794083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] PATH_INFO: `/v3/users/4b908325c22e4cd2801f6a9360962755` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:46.795306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b908325c22e4cd2801f6a9360962755)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:46.797224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:46.842471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b908325c22e4cd2801f6a9360962755'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.852890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b908325c22e4cd2801f6a9360962755'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.853524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b908325c22e4cd2801f6a9360962755'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.859208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:46.861103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b908325c22e4cd2801f6a9360962755'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.874015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1b1d927a-e9e7-410d-9e9f-0ae69ebab004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b908325c22e4cd2801f6a9360962755'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:46.882948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 964/1858] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:46 2022] DELETE /identity/v3/users/4b908325c22e4cd2801f6a9360962755 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:47.255436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.257003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:47.270810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87544e-4119-4f36-9b00-54ff08ac8700 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:47.327578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:47.328455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.328744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.329023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] PATH_INFO: `/v3/projects/425a888ff3d6437ebbb3fdfd2c3ff2b5` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.330694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] RBAC: Authorizing `identity:delete_project(project_id=425a888ff3d6437ebbb3fdfd2c3ff2b5)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:47.332630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:47.378679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425a888ff3d6437ebbb3fdfd2c3ff2b5', 'request_id': 'req-75db9093-b605-42e0-a5e7-85efbba5781c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:47.385173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425a888ff3d6437ebbb3fdfd2c3ff2b5', 'request_id': 'req-75db9093-b605-42e0-a5e7-85efbba5781c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:47.390637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425a888ff3d6437ebbb3fdfd2c3ff2b5', 'request_id': 'req-75db9093-b605-42e0-a5e7-85efbba5781c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:47.401866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] The token cache is being invalidate because project 425a888ff3d6437ebbb3fdfd2c3ff2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:47.402157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:47.402799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-75db9093-b605-42e0-a5e7-85efbba5781c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:47.404365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 895/1859] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:47 2022] DELETE /identity/v3/projects/425a888ff3d6437ebbb3fdfd2c3ff2b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:47.409782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29373-ea50-48bb-9878-3cec7f9e6aff None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.410081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29373-ea50-48bb-9878-3cec7f9e6aff None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.410367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29373-ea50-48bb-9878-3cec7f9e6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.428594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-53e29373-ea50-48bb-9878-3cec7f9e6aff None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:47.429780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-53e29373-ea50-48bb-9878-3cec7f9e6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:47.487447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 965/1860] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:47.494927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b5a8-512a-4a72-90ab-d29817d0b3fb None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.495241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b5a8-512a-4a72-90ab-d29817d0b3fb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.495531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b5a8-512a-4a72-90ab-d29817d0b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.513377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-db25b5a8-512a-4a72-90ab-d29817d0b3fb None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:47.514579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-db25b5a8-512a-4a72-90ab-d29817d0b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:47.522945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 896/1861] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:47.527824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e29373-ea50-48bb-9878-3cec7f9e6aff None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.539691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e29373-ea50-48bb-9878-3cec7f9e6aff None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:47.544456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:47.545130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.545415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.545690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.546430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:47.546737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:47.548366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:47.560157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 966/1862] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:46:47.564564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25b5a8-512a-4a72-90ab-d29817d0b3fb None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.574167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25b5a8-512a-4a72-90ab-d29817d0b3fb None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:47.578907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:47.580100 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.580379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.580658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.581370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:47.583290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:47.613095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 897/1863] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:47 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:47.617065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.628251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd1ffb-92bf-421b-a517-d1e28a74045d admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:47.693883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:47.694568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.694856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.695580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.696303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:47.698240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:47.723965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 967/1864] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:47 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:47.728105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.739240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcf9fe-ece8-4d5d-92f1-0daf22860051 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:47.744175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:47.744851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.745140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.745421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.746149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:47.747775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:47.763983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 898/1865] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:47.767982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.777838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59c0d-f0e7-4f15-93b1-20d63950ea74 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:47.782482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd1104-cf58-45b7-b8a3-413a9a3cb2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:47.783696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd1104-cf58-45b7-b8a3-413a9a3cb2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.783986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd1104-cf58-45b7-b8a3-413a9a3cb2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.784271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd1104-cf58-45b7-b8a3-413a9a3cb2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.785003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd1104-cf58-45b7-b8a3-413a9a3cb2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:47.786599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd1104-cf58-45b7-b8a3-413a9a3cb2d4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:47.796987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 968/1866] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:47.801639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.811426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5b329-66b1-4bcf-985e-4894fb7c88ed admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:47.816432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:47.817309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.817593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.817868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] PATH_INFO: `/v3/projects/9b27f256c783495ba437ec3f3863fdfb/users/b68efa21d3784f4695ae20bf44a44b14/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.832530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b27f256c783495ba437ec3f3863fdfb, user_id=b68efa21d3784f4695ae20bf44a44b14, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:47.835182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:47.838080 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:47.850454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 899/1867] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:47 2022] PUT /identity/v3/projects/9b27f256c783495ba437ec3f3863fdfb/users/b68efa21d3784f4695ae20bf44a44b14/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:47.860715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df507ed-5c76-438f-88d2-b8ab741a114c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:47.861020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df507ed-5c76-438f-88d2-b8ab741a114c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:47.861307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df507ed-5c76-438f-88d2-b8ab741a114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:47.887672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1df507ed-5c76-438f-88d2-b8ab741a114c None None] MFA Rules not processed for user `b68efa21d3784f4695ae20bf44a44b14`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:47.888806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1df507ed-5c76-438f-88d2-b8ab741a114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:47.918525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:47.956708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 969/1868] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:47.967818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:47.969586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:48.027489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4721c-2bf7-4679-88fc-2a447712317d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:48.031161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a40fa-2f50-4917-ae53-a0a0f42ac1dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:48.031827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a40fa-2f50-4917-ae53-a0a0f42ac1dd service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.032122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a40fa-2f50-4917-ae53-a0a0f42ac1dd service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.032426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a40fa-2f50-4917-ae53-a0a0f42ac1dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.041552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a40fa-2f50-4917-ae53-a0a0f42ac1dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:48.043010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a40fa-2f50-4917-ae53-a0a0f42ac1dd service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:48.052819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 900/1869] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:48.072040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df507ed-5c76-438f-88d2-b8ab741a114c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:48.142896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df507ed-5c76-438f-88d2-b8ab741a114c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:48.147980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:48.148572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.148861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.149142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] PATH_INFO: `/v3/users/b68efa21d3784f4695ae20bf44a44b14` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.150506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68efa21d3784f4695ae20bf44a44b14)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:48.152480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:48.202871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68efa21d3784f4695ae20bf44a44b14'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.210649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68efa21d3784f4695ae20bf44a44b14'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.211305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68efa21d3784f4695ae20bf44a44b14'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.218300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68efa21d3784f4695ae20bf44a44b14'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.230195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68efa21d3784f4695ae20bf44a44b14'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.236718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 970/1870] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:48 2022] DELETE /identity/v3/users/b68efa21d3784f4695ae20bf44a44b14 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:48.241176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.241537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.241890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.259270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:48.260502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:48.322899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 901/1871] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:48.333120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:48.334502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:48.386818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:48.390550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d7891-da15-4190-b93c-6e9951210fb7 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:48.395285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd324-676b-40d7-bc5e-f763fc0702e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:48.396043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd324-676b-40d7-bc5e-f763fc0702e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.396510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd324-676b-40d7-bc5e-f763fc0702e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.396963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd324-676b-40d7-bc5e-f763fc0702e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.406073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd324-676b-40d7-bc5e-f763fc0702e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:48.407536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd324-676b-40d7-bc5e-f763fc0702e0 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:48.417789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 971/1872] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:48.680465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:48.682365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:48.696723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf6ccd-a478-4549-88bf-ff5463039d18 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:48.719555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:48.720259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.720553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.720839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] PATH_INFO: `/v3/projects/9b27f256c783495ba437ec3f3863fdfb` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.722066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b27f256c783495ba437ec3f3863fdfb)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:48.724050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:48.778518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b27f256c783495ba437ec3f3863fdfb', 'request_id': 'req-505f0d7b-8f1e-47be-aa89-baa16842823d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.789266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b27f256c783495ba437ec3f3863fdfb', 'request_id': 'req-505f0d7b-8f1e-47be-aa89-baa16842823d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.797631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b27f256c783495ba437ec3f3863fdfb', 'request_id': 'req-505f0d7b-8f1e-47be-aa89-baa16842823d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.811993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] The token cache is being invalidate because project 9b27f256c783495ba437ec3f3863fdfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:48.812518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.813068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-505f0d7b-8f1e-47be-aa89-baa16842823d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:48.815795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 902/1873] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:48 2022] DELETE /identity/v3/projects/9b27f256c783495ba437ec3f3863fdfb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:48.821294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9734-95ff-48fd-98c3-96cba3800ca8 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.821745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9734-95ff-48fd-98c3-96cba3800ca8 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.821862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9734-95ff-48fd-98c3-96cba3800ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.843138 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8a2d9734-95ff-48fd-98c3-96cba3800ca8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:48.844335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8a2d9734-95ff-48fd-98c3-96cba3800ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:48.904215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 972/1874] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:48.913130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf454ed-6892-4a58-9456-68c2fa545c38 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.913433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf454ed-6892-4a58-9456-68c2fa545c38 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.913723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf454ed-6892-4a58-9456-68c2fa545c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.932605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2cf454ed-6892-4a58-9456-68c2fa545c38 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:48.933822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2cf454ed-6892-4a58-9456-68c2fa545c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:48.942467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 903/1875] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:48.946647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d9734-95ff-48fd-98c3-96cba3800ca8 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:48.956569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d9734-95ff-48fd-98c3-96cba3800ca8 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:48.961522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:48.962218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.962515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.962806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.963657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:48.963978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:48.965586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:48.977435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 973/1876] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:46:48.981575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf454ed-6892-4a58-9456-68c2fa545c38 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:48.991590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf454ed-6892-4a58-9456-68c2fa545c38 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:48.996640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:48.997304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:48.997600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:48.997888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:48.998593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:49.000537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:49.014638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:49.032913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 904/1877] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:48 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:49.037105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:49.047208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cede64-4efc-49db-8c3d-6c3522fdf0e6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:49.102151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:49.102824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:49.103141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:49.103425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:49.104122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:49.106025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:49.125975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 974/1878] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:49 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:49.130759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:49.141073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de7910-cd2e-4917-aab1-c9e325c0c4b0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:49.145862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:49.146536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:49.146825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:49.147134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:49.147869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:49.149458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:49.160409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 905/1879] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:49.164765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:49.175331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e19624-656b-41ea-a722-51a354c4a13e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:49.180133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee773a-bc5d-4604-a387-8e7f26de91c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:49.180831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee773a-bc5d-4604-a387-8e7f26de91c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:49.181103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee773a-bc5d-4604-a387-8e7f26de91c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:49.181394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee773a-bc5d-4604-a387-8e7f26de91c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:49.182139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee773a-bc5d-4604-a387-8e7f26de91c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:49.183826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee773a-bc5d-4604-a387-8e7f26de91c0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:49.194486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 975/1880] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:49.199099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:49.209197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04da80-9111-4f24-a257-b8c727e74f6b admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:49.213838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:49.214763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:49.215102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:49.215382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] PATH_INFO: `/v3/projects/8c41eabade644271ac01e833aa30a858/users/2c6c86ea7f784e5d8378fa13438c8e2b/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:49.231096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c41eabade644271ac01e833aa30a858, user_id=2c6c86ea7f784e5d8378fa13438c8e2b, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:49.233744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:49.249321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 906/1881] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:49 2022] PUT /identity/v3/projects/8c41eabade644271ac01e833aa30a858/users/2c6c86ea7f784e5d8378fa13438c8e2b/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:49.259319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:49.259723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:49.260087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:49.289927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] MFA Rules not processed for user `2c6c86ea7f784e5d8378fa13438c8e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:49.291317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:49.341842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:49.363857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 976/1882] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:49.375539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:49.377908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:49.437415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab9a0-d4ad-4594-ad0f-6f1c8f1ce8dc admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:49.441264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880c7a0632ef44a1ab446d1bb53399fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:49.441982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:49.442274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:49.442680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:49.453263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:49.454706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:49.463476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 907/1883] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:52.111058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:52.112646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:52.185211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d759e9-8aba-4216-8bad-99ae3f2fde27 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:52.207932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:52.209298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:52.211321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:52.211981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:52.214745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:52.290087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:52.292200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:52.302843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 977/1884] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:53.118047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:53.129550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b2535-6fe8-4ceb-8e72-d4e58429e3ca service glance] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:53.133701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29571da3-4f85-445e-9305-39e17737e298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:53.134382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29571da3-4f85-445e-9305-39e17737e298 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:53.134669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29571da3-4f85-445e-9305-39e17737e298 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:53.134968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29571da3-4f85-445e-9305-39e17737e298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:53.137224 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-29571da3-4f85-445e-9305-39e17737e298 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:53.202874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29571da3-4f85-445e-9305-39e17737e298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:53.204375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29571da3-4f85-445e-9305-39e17737e298 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:53.214620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 908/1885] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:53.776370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:53.787276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b08a8-4e92-4c20-8d56-ef3e510bb704 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:53.790948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b8f08-79a7-4f96-b4ef-512ef4155cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:53.791618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b8f08-79a7-4f96-b4ef-512ef4155cab service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:53.791916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b8f08-79a7-4f96-b4ef-512ef4155cab service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:53.792222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b8f08-79a7-4f96-b4ef-512ef4155cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:53.794119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-cd3b8f08-79a7-4f96-b4ef-512ef4155cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:53.859062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b8f08-79a7-4f96-b4ef-512ef4155cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:53.860426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b8f08-79a7-4f96-b4ef-512ef4155cab service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:53.870110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 978/1886] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:55.291153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de977-509e-4baf-b3ec-7918c0aa9892 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:55.291655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de977-509e-4baf-b3ec-7918c0aa9892 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:55.291775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de977-509e-4baf-b3ec-7918c0aa9892 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:55.293264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 909/1887] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:46:55.308151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:55.308836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:55.309380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:55.335381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:55.336607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:55.375053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:55.411766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 979/1888] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:55.424154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de977-509e-4baf-b3ec-7918c0aa9892 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:55.425856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1d2de977-509e-4baf-b3ec-7918c0aa9892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:55.443866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de977-509e-4baf-b3ec-7918c0aa9892 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:55.449227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903a37-4670-4a5b-a66e-9f11b9d0a32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:55.449895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903a37-4670-4a5b-a66e-9f11b9d0a32d service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:55.450183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903a37-4670-4a5b-a66e-9f11b9d0a32d service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:55.450463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903a37-4670-4a5b-a66e-9f11b9d0a32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:55.460587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2903a37-4670-4a5b-a66e-9f11b9d0a32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:55.462256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2903a37-4670-4a5b-a66e-9f11b9d0a32d service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:55.473159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 910/1889] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:56.174728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:56.176308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:56.279639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024afd-eecf-413a-9978-2a87ac51a2d1 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:56.284672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:56.285577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:56.285867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:56.286149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] PATH_INFO: `/v3/users/e78f681e47f74bafa91d841b80efd862` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:56.287638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78f681e47f74bafa91d841b80efd862)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:56.289605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:56.344913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78f681e47f74bafa91d841b80efd862'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:56.356951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78f681e47f74bafa91d841b80efd862'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:56.357935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78f681e47f74bafa91d841b80efd862'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:56.376976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78f681e47f74bafa91d841b80efd862'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:56.401431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78f681e47f74bafa91d841b80efd862'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:56.417786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 980/1890] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:56 2022] DELETE /identity/v3/users/e78f681e47f74bafa91d841b80efd862 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:56.422400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:56.422873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:56.423193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:56.459278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:56.460847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:56.530652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:56.567581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 911/1891] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:56.577483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:56.585467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:56.638076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2f24d-6012-499b-aeec-9c8c4255daed admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:56.641630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:56.642305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:56.642592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:56.642868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:56.648647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:56.653567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:56.655521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:56.666525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 981/1892] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:56.940265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:56.941693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:56.954050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cda5f-485d-4d55-99d6-71861b16e1a9 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:56.960171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:56.961309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:56.961596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:56.961876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] PATH_INFO: `/v3/projects/47ec49c30c2b4720a0a25351e253bb55` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:56.963227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ec49c30c2b4720a0a25351e253bb55)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:56.965143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:57.015860 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ec49c30c2b4720a0a25351e253bb55', 'request_id': 'req-b4a9898c-3a45-4a1d-829f-5880f60f7067'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.025742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ec49c30c2b4720a0a25351e253bb55', 'request_id': 'req-b4a9898c-3a45-4a1d-829f-5880f60f7067'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.032041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ec49c30c2b4720a0a25351e253bb55', 'request_id': 'req-b4a9898c-3a45-4a1d-829f-5880f60f7067'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.043664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] The token cache is being invalidate because project 47ec49c30c2b4720a0a25351e253bb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:57.043958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.044625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.046214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 912/1893] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:56 2022] DELETE /identity/v3/projects/47ec49c30c2b4720a0a25351e253bb55 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:57.050737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:57.060096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09105-c0e2-43ba-becd-282893cd05b7 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:57.119163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:57.120067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:57.120357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:57.120642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] PATH_INFO: `/v3/users/d5bfb79aab494cdab2c4c37d280dd3e2` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:57.121952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bfb79aab494cdab2c4c37d280dd3e2)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:57.123955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:57.176047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bfb79aab494cdab2c4c37d280dd3e2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.192305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bfb79aab494cdab2c4c37d280dd3e2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.193152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bfb79aab494cdab2c4c37d280dd3e2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.201646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bfb79aab494cdab2c4c37d280dd3e2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.221231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-258b93e5-560e-43d8-b02d-437f29058a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bfb79aab494cdab2c4c37d280dd3e2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.234137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 982/1894] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:57 2022] DELETE /identity/v3/users/d5bfb79aab494cdab2c4c37d280dd3e2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:57.243279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:57.245215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:57.274334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9898c-3a45-4a1d-829f-5880f60f7067 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:57.381930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:57.382880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:57.383298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:57.383615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] PATH_INFO: `/v3/users/e469f50aeafc4e7db14b6585b004836a` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:57.385658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e469f50aeafc4e7db14b6585b004836a)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:57.388161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:57.460092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e469f50aeafc4e7db14b6585b004836a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.472243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e469f50aeafc4e7db14b6585b004836a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.485341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e469f50aeafc4e7db14b6585b004836a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.486630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e469f50aeafc4e7db14b6585b004836a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.487514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e469f50aeafc4e7db14b6585b004836a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:57.495078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:57.527933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 913/1895] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:57 2022] DELETE /identity/v3/users/e469f50aeafc4e7db14b6585b004836a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:57.534260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:57.534837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:57.535049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:57.562554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:57.564696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:57.688485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 983/1896] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:46:57.796899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:57.800195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:57.954060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1a901-2995-4dd0-b47a-583afc2ad25f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:57.967719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:57.971173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:57.971995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:57.973389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:58.006091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:58.009655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:58.028248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 914/1897] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:46:58.071462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:58.072985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:58.086956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a777-ad5b-423f-8c20-1d3f5610760a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:58.097456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:58.098767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:58.099159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:58.099542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] PATH_INFO: `/v3/projects/1ae369873c5446d293fb5bf2c05c7f8f` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:58.100946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae369873c5446d293fb5bf2c05c7f8f)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:58.103115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:58.113810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:58.168533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae369873c5446d293fb5bf2c05c7f8f', 'request_id': 'req-4776d08f-4164-46e4-b9aa-755e296c5211'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.178981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae369873c5446d293fb5bf2c05c7f8f', 'request_id': 'req-4776d08f-4164-46e4-b9aa-755e296c5211'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.187344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae369873c5446d293fb5bf2c05c7f8f', 'request_id': 'req-4776d08f-4164-46e4-b9aa-755e296c5211'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.206968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] The token cache is being invalidate because project 1ae369873c5446d293fb5bf2c05c7f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:58.207299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.207999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.209741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 984/1898] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:58 2022] DELETE /identity/v3/projects/1ae369873c5446d293fb5bf2c05c7f8f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:58.214011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:58.224942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64d1e3-c76f-478f-8593-7a1562a4e740 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:58.297948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:58.298950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:58.299797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:58.299797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] PATH_INFO: `/v3/users/2ffdf75fdf6d4ea59d8d47ce115a2736` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:58.303361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffdf75fdf6d4ea59d8d47ce115a2736)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:58.307256 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:58.414275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffdf75fdf6d4ea59d8d47ce115a2736'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.423562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffdf75fdf6d4ea59d8d47ce115a2736'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.440468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffdf75fdf6d4ea59d8d47ce115a2736'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.441763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffdf75fdf6d4ea59d8d47ce115a2736'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.442621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffdf75fdf6d4ea59d8d47ce115a2736'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:58.463086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 915/1899] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:58 2022] DELETE /identity/v3/users/2ffdf75fdf6d4ea59d8d47ce115a2736 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:58.899472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:58.901502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:58.915577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776d08f-4164-46e4-b9aa-755e296c5211 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:58.957160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:58.963301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:58.976270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:58.990595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:58.991368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:58.991772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:58.992181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] PATH_INFO: `/v3/projects/74d316cb5e62493396c570a9d455dc62` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:58.993393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d316cb5e62493396c570a9d455dc62)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:58.995360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.043486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3930e3-ab9a-46a2-a432-e7011c58d987 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.048305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d316cb5e62493396c570a9d455dc62', 'request_id': 'req-779e1ec3-d041-4653-a1a1-219565646478'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.058813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d316cb5e62493396c570a9d455dc62', 'request_id': 'req-779e1ec3-d041-4653-a1a1-219565646478'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.068936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d316cb5e62493396c570a9d455dc62', 'request_id': 'req-779e1ec3-d041-4653-a1a1-219565646478'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.080877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] The token cache is being invalidate because project 74d316cb5e62493396c570a9d455dc62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:59.081198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.081855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.083467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 985/1900] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:58 2022] DELETE /identity/v3/projects/74d316cb5e62493396c570a9d455dc62 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:46:59.087447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.088831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:59.104491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.105561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.105827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.106099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] PATH_INFO: `/v3/projects/ef6f153c71c44592ba9b85a97121df90` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.107938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6f153c71c44592ba9b85a97121df90)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.109765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.132361 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:59.172316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6f153c71c44592ba9b85a97121df90', 'request_id': 'req-dedc121e-9e00-4fcd-865a-82875346ff1d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.180852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1ec3-d041-4653-a1a1-219565646478 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.182354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6f153c71c44592ba9b85a97121df90', 'request_id': 'req-dedc121e-9e00-4fcd-865a-82875346ff1d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.189258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6f153c71c44592ba9b85a97121df90', 'request_id': 'req-dedc121e-9e00-4fcd-865a-82875346ff1d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.201919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] The token cache is being invalidate because project ef6f153c71c44592ba9b85a97121df90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:59.202219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.203166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dedc121e-9e00-4fcd-865a-82875346ff1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.205046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 916/1901] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:58 2022] DELETE /identity/v3/projects/ef6f153c71c44592ba9b85a97121df90 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:59.211393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819add2-2a4a-4a12-b6e9-aef2c72c8f25 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.212419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819add2-2a4a-4a12-b6e9-aef2c72c8f25 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.213019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819add2-2a4a-4a12-b6e9-aef2c72c8f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.238729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-f819add2-2a4a-4a12-b6e9-aef2c72c8f25 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:59.239972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f819add2-2a4a-4a12-b6e9-aef2c72c8f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:59.250801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.252457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.252805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.253120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] PATH_INFO: `/v3/users/c361d8d893fb476ab78864456fe98155` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.254367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c361d8d893fb476ab78864456fe98155)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.256420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.285246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:59.305951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 917/1902] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:59.315113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d799f5-bfb0-4dfc-8e87-29272575eae2 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.315598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d799f5-bfb0-4dfc-8e87-29272575eae2 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.316073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d799f5-bfb0-4dfc-8e87-29272575eae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.317430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c361d8d893fb476ab78864456fe98155'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.324569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c361d8d893fb476ab78864456fe98155'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.325322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c361d8d893fb476ab78864456fe98155'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.333068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c361d8d893fb476ab78864456fe98155'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.334352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b7d799f5-bfb0-4dfc-8e87-29272575eae2 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:59.335591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b7d799f5-bfb0-4dfc-8e87-29272575eae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:59.343506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 918/1903] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:46:59.348217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d799f5-bfb0-4dfc-8e87-29272575eae2 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.352713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c361d8d893fb476ab78864456fe98155'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.359610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 986/1904] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:59 2022] DELETE /identity/v3/users/c361d8d893fb476ab78864456fe98155 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:59.365771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d799f5-bfb0-4dfc-8e87-29272575eae2 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.440782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.441611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.442287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.442557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.443617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:46:59.444112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.446021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.461083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 919/1905] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:46:59.466268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.467832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:59.485946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9a8f-98b3-4676-98f9-d31c9fd2aeca admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.490507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.491413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.491707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.491991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.492740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.495090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.526174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 987/1906] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:46:59 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:46:59.527593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.557128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf480-3db0-4b7a-b479-bbb0545f5e48 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.627631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.628368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.628738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.629258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.630086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.632221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.653991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 920/1907] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:46:59 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:46:59.658440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.671877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596d78-3b6e-422f-9759-067a92b2be14 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.678043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.679055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.679410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.679812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.681213 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.683873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.691418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.693163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:59.710769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff4ee3-6b50-4d75-8b3f-6afae903e60a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.711461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 988/1908] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:59.716264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.717330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.717772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.718377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] PATH_INFO: `/v3/projects/1cc40246a5a646d184fad86c6f35da1e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.720346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc40246a5a646d184fad86c6f35da1e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.722432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.730532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.750075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40ef4-da29-4eb8-8f8b-ed998b23d272 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.755049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.755739 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.756034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.756318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.757057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.758667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.769997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 989/1909] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:46:59.774619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.786063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48cf60-7127-4643-a7f5-40e0067d8105 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.790875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc40246a5a646d184fad86c6f35da1e', 'request_id': 'req-68a90262-0da3-4aad-8bff-5d1013a3786d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.791573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:59.802087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc40246a5a646d184fad86c6f35da1e', 'request_id': 'req-68a90262-0da3-4aad-8bff-5d1013a3786d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.803724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:46:59.814481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc40246a5a646d184fad86c6f35da1e', 'request_id': 'req-68a90262-0da3-4aad-8bff-5d1013a3786d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.827932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] The token cache is being invalidate because project 1cc40246a5a646d184fad86c6f35da1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:46:59.828261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.828884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:46:59.830490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 921/1910] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:46:59 2022] DELETE /identity/v3/projects/1cc40246a5a646d184fad86c6f35da1e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:59.834196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:46:59.835691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:59.857813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2dc07-1e49-42fa-a0a0-db908f620ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.859021 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2dc07-1e49-42fa-a0a0-db908f620ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.859317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2dc07-1e49-42fa-a0a0-db908f620ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.859602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2dc07-1e49-42fa-a0a0-db908f620ed3 admin admin] PATH_INFO: `/v3/projects/e86dc9051c984aebaf34f364778d46f7/users/7b73aa4a897e479fb280f73d6f8183d6/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.875822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2dc07-1e49-42fa-a0a0-db908f620ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86dc9051c984aebaf34f364778d46f7, user_id=7b73aa4a897e479fb280f73d6f8183d6, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.880345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2dc07-1e49-42fa-a0a0-db908f620ed3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:46:59.898311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 990/1911] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:46:59 2022] PUT /identity/v3/projects/e86dc9051c984aebaf34f364778d46f7/users/7b73aa4a897e479fb280f73d6f8183d6/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:46:59.907813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90262-0da3-4aad-8bff-5d1013a3786d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:46:59.922464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.923063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.923686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.950814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] MFA Rules not processed for user `7b73aa4a897e479fb280f73d6f8183d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:46:59.952055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:46:59.978654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:46:59.980226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:46:59.980226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:46:59.980226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] PATH_INFO: `/v3/users/0cab15bee284438eb7cdb9be467b9dd9` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:46:59.981387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cab15bee284438eb7cdb9be467b9dd9)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:46:59.983356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.022776 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 991/1912] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:00.027223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.028567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.040489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cab15bee284438eb7cdb9be467b9dd9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.043127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9cd92-c881-4b30-b566-6250c5ea473e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.047819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.048540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cab15bee284438eb7cdb9be467b9dd9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.049004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.049300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.049585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.050290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.052960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.058094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cab15bee284438eb7cdb9be467b9dd9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.061525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cab15bee284438eb7cdb9be467b9dd9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.062171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cab15bee284438eb7cdb9be467b9dd9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.089935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 992/1913] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:00 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:00.091018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 922/1914] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:46:59 2022] DELETE /identity/v3/users/0cab15bee284438eb7cdb9be467b9dd9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:00.094025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.096350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.110943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:00.169857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d715a-3791-4f72-ae75-4b722f9e291a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.174581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.175293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.175579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.175863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.176552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.178463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.202131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 923/1915] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:00 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:00.203353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.278559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc33729-fe44-402c-93b6-a52bb24daeb2 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.284335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.285151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.285611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.285961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.286765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.288730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.290290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:00.303671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 993/1916] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:47:00.304826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.315509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec03f6-183b-4073-ac6e-44494cf84739 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.320998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.321835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.322363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.322652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] PATH_INFO: `/v3/projects/a443b32706b6454ca2726c773e12aeee/users/c92769271e4a4422b8352b571cf1fc71/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.341990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a443b32706b6454ca2726c773e12aeee, user_id=c92769271e4a4422b8352b571cf1fc71, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.345699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.366357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 924/1917] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:00 2022] PUT /identity/v3/projects/a443b32706b6454ca2726c773e12aeee/users/c92769271e4a4422b8352b571cf1fc71/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:00.372083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.372369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.374420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.388715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7df35-8f00-46fb-b978-882643c5ed87 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.460106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4bea4-0c87-404c-9362-12a9845d59bb admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.467751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.468308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.468817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.469106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.469208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.469521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.469825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] PATH_INFO: `/v3/projects/f9cf0d5204094168a5c68fa9b17113f9` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.469938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.470606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.471571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9cf0d5204094168a5c68fa9b17113f9)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.472273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.473921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.486278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 994/1918] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:00.487342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.497667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd8471-4668-4e25-a511-2159b9b3b0b2 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.502803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2064-c45d-422d-b986-122a2cbdc453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.503812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2064-c45d-422d-b986-122a2cbdc453 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.504110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2064-c45d-422d-b986-122a2cbdc453 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.504402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2064-c45d-422d-b986-122a2cbdc453 admin admin] PATH_INFO: `/v3/projects/a443b32706b6454ca2726c773e12aeee/users/c92769271e4a4422b8352b571cf1fc71/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.506359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2064-c45d-422d-b986-122a2cbdc453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a443b32706b6454ca2726c773e12aeee, user_id=c92769271e4a4422b8352b571cf1fc71, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.509052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2064-c45d-422d-b986-122a2cbdc453 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.521843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 995/1919] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:00 2022] PUT /identity/v3/projects/a443b32706b6454ca2726c773e12aeee/users/c92769271e4a4422b8352b571cf1fc71/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:00.530890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9cf0d5204094168a5c68fa9b17113f9', 'request_id': 'req-4e6c704a-61b9-4abf-a7d4-1df20861d46b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.533226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.533658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.533962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.540476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9cf0d5204094168a5c68fa9b17113f9', 'request_id': 'req-4e6c704a-61b9-4abf-a7d4-1df20861d46b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.546353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9cf0d5204094168a5c68fa9b17113f9', 'request_id': 'req-4e6c704a-61b9-4abf-a7d4-1df20861d46b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.557524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] The token cache is being invalidate because project f9cf0d5204094168a5c68fa9b17113f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:00.557815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.558479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4e6c704a-61b9-4abf-a7d4-1df20861d46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:00.560093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 925/1920] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:00 2022] DELETE /identity/v3/projects/f9cf0d5204094168a5c68fa9b17113f9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:00.561139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] MFA Rules not processed for user `c92769271e4a4422b8352b571cf1fc71`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:00.562350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.565290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87e4f-1612-4529-b5a8-d334c0dbbd6c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.565589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87e4f-1612-4529-b5a8-d334c0dbbd6c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.565879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def87e4f-1612-4529-b5a8-d334c0dbbd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.577759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:00.584535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-def87e4f-1612-4529-b5a8-d334c0dbbd6c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:00.586380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-def87e4f-1612-4529-b5a8-d334c0dbbd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.635831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 996/1921] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:00.647716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.648917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 926/1922] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:00.654447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.657690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abdcd6-c98f-445b-b8c4-26d5d5733df9 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.658001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abdcd6-c98f-445b-b8c4-26d5d5733df9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.658289 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abdcd6-c98f-445b-b8c4-26d5d5733df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.677582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a6abdcd6-c98f-445b-b8c4-26d5d5733df9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:00.678850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a6abdcd6-c98f-445b-b8c4-26d5d5733df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.687893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 927/1923] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:00.693062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abdcd6-c98f-445b-b8c4-26d5d5733df9 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.704982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abdcd6-c98f-445b-b8c4-26d5d5733df9 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.709793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.710656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.714243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.714243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.714243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:00.714243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.714609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.715386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e62c4-d814-4c07-93f3-6665360520be None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.719153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.719911 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.720127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.720410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.729888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 928/1924] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:47:00.730244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.731078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.731819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.742582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 997/1925] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:47:00.745620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f183c1-7dec-4108-af5c-fd07a13a7782 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.755652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.756344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.756798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.757090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.757953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.759954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.789520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 929/1926] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:00 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:00.793538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.805592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.806108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b3e6-16ba-4d32-999e-176bc639b0e8 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.807508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.812238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:00.872073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29509e0-6ff4-4355-a0a6-0093b1773a3f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.876412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.877103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.877421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.877708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.878438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.879582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.880423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.880537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.880715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.880961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.882842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:00.924312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 998/1927] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:00 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:00.928756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.943827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462a21c-34d3-4d55-9ca1-9e16cdbc87ef admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.949992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.950841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.951164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.951445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.952314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.953917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.971420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 999/1928] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:00.972796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:00.980612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.982846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:00.986942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ace4-fd3a-45f3-bf46-af2a0466b413 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:00.993502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d587f17-1cb4-49ab-bc3c-02a5916298f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:00.994186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d587f17-1cb4-49ab-bc3c-02a5916298f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:00.994475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d587f17-1cb4-49ab-bc3c-02a5916298f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:00.994803 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d587f17-1cb4-49ab-bc3c-02a5916298f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:00.995591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d587f17-1cb4-49ab-bc3c-02a5916298f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:00.996020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 930/1929] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:47:01.000628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d587f17-1cb4-49ab-bc3c-02a5916298f6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:01.014489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1000/1930] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:01.019838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:01.034289 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b3e5-03d7-4d3d-ba83-df1a7f226f37 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:01.043182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:01.044135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:01.044555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:01.045520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] PATH_INFO: `/v3/projects/01e9e6e0f0c84889adbb91c5af1c0b33/users/69e9236fdb39431ca379809fca5cd53f/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:01.064152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e9e6e0f0c84889adbb91c5af1c0b33, user_id=69e9236fdb39431ca379809fca5cd53f, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:01.068760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:01.072896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:01.088463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 931/1931] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:01 2022] PUT /identity/v3/projects/01e9e6e0f0c84889adbb91c5af1c0b33/users/69e9236fdb39431ca379809fca5cd53f/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:01.101579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:01.101957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:01.102396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:01.171380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] MFA Rules not processed for user `69e9236fdb39431ca379809fca5cd53f`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:01.173807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:01.268276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1001/1932] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:01.284392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:01.368388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdb290-8363-49f6-a2fb-59ab35600ec4 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:01.373631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fc14b-889d-4aae-b8e7-7d3c94fe3946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:01.375130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fc14b-889d-4aae-b8e7-7d3c94fe3946 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:01.375653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fc14b-889d-4aae-b8e7-7d3c94fe3946 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:01.376657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fc14b-889d-4aae-b8e7-7d3c94fe3946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:01.387756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fc14b-889d-4aae-b8e7-7d3c94fe3946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:01.390567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fc14b-889d-4aae-b8e7-7d3c94fe3946 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:01.415781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 932/1933] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:06.619367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:06.621409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:06.691499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a062-a4bc-4c96-b96a-4533863db42a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:06.696058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:06.697431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:06.697431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:06.697609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] PATH_INFO: `/v3/users/7b73aa4a897e479fb280f73d6f8183d6` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:06.699147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b73aa4a897e479fb280f73d6f8183d6)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:06.700704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:06.706057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:06.759206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b73aa4a897e479fb280f73d6f8183d6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:06.767829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b73aa4a897e479fb280f73d6f8183d6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:06.768525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b73aa4a897e479fb280f73d6f8183d6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:06.775773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b73aa4a897e479fb280f73d6f8183d6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:06.789084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b73aa4a897e479fb280f73d6f8183d6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:06.795864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1002/1934] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:06 2022] DELETE /identity/v3/users/7b73aa4a897e479fb280f73d6f8183d6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:06.800380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:06.800822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:06.800932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:06.818530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:06.819779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:06.886018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 933/1935] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:06.893208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:06.894708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:06.969346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb796-4c44-45dc-88e0-d20eb0ed773a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:06.973724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:06.974553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:06.975033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:06.975389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:06.996746 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:06.998629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:07.023123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1003/1936] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:47:07.405696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:07.409578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:07.427280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520c3e9-e484-49a7-98f9-ade5857ff148 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:07.433347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:07.434940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:07.435288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:07.435577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] PATH_INFO: `/v3/users/fbd58fa54588416ab254e504266cb0a0` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:07.439466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd58fa54588416ab254e504266cb0a0)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:07.441431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:07.524349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:07.525726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:07.546452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd58fa54588416ab254e504266cb0a0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.559748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227440ed-a030-4504-928f-16385be15fd4 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:07.568972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd58fa54588416ab254e504266cb0a0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.575170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:07.577105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:07.577385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:07.577835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] PATH_INFO: `/v3/projects/e86dc9051c984aebaf34f364778d46f7` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:07.580150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86dc9051c984aebaf34f364778d46f7)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:07.582755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:07.584262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd58fa54588416ab254e504266cb0a0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.584912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd58fa54588416ab254e504266cb0a0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.586714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb1b9bea-f9c9-4089-a755-841f1f854a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd58fa54588416ab254e504266cb0a0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.615484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 934/1937] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:07 2022] DELETE /identity/v3/users/fbd58fa54588416ab254e504266cb0a0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:07.620378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:07.621007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:07.621546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:07.669654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:07.672153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:07.680981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86dc9051c984aebaf34f364778d46f7', 'request_id': 'req-bff3a6c5-a236-4fb9-8c77-25100ac5d253'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.681470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:07.697398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86dc9051c984aebaf34f364778d46f7', 'request_id': 'req-bff3a6c5-a236-4fb9-8c77-25100ac5d253'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.705262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86dc9051c984aebaf34f364778d46f7', 'request_id': 'req-bff3a6c5-a236-4fb9-8c77-25100ac5d253'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.725591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] The token cache is being invalidate because project e86dc9051c984aebaf34f364778d46f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:07.725891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.726561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.729601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1004/1938] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:07 2022] DELETE /identity/v3/projects/e86dc9051c984aebaf34f364778d46f7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:07.733816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:07.736158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:07.757013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:07.786367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 935/1939] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:07.796814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:07.799770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:07.882771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5903f-f75a-4619-a3ee-7b616d33e54c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:07.884425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3a6c5-a236-4fb9-8c77-25100ac5d253 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:07.886819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:07.887522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:07.887868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:07.888163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:07.889321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:07.890289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:07.890588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:07.890876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] PATH_INFO: `/v3/users/c92769271e4a4422b8352b571cf1fc71` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:07.892245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92769271e4a4422b8352b571cf1fc71)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:07.894193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:07.898270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:07.899753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:07.910788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 936/1940] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:07.951490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92769271e4a4422b8352b571cf1fc71'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.959455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92769271e4a4422b8352b571cf1fc71'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.960655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92769271e4a4422b8352b571cf1fc71'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.967917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92769271e4a4422b8352b571cf1fc71'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.982751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92769271e4a4422b8352b571cf1fc71'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:07.990645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1005/1941] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:07 2022] DELETE /identity/v3/users/c92769271e4a4422b8352b571cf1fc71 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:08.271927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:08.273571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:08.293852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f40a0-91c4-4ddf-8dcb-96d4b5b23b03 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:08.381581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:08.382518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:08.382806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:08.383121 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] PATH_INFO: `/v3/projects/cea270975d1d49d2b00c9408279bf867` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:08.384599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea270975d1d49d2b00c9408279bf867)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:08.384777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:08.386345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:08.386944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:08.408789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2d3c3-d962-4852-aadf-164286856c79 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:08.420553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:08.425625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:08.426067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:08.426527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] PATH_INFO: `/v3/projects/a443b32706b6454ca2726c773e12aeee` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:08.430624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a443b32706b6454ca2726c773e12aeee)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:08.438214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:08.447590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea270975d1d49d2b00c9408279bf867', 'request_id': 'req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.460010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea270975d1d49d2b00c9408279bf867', 'request_id': 'req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.462136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:08.473107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea270975d1d49d2b00c9408279bf867', 'request_id': 'req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.497419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] The token cache is being invalidate because project cea270975d1d49d2b00c9408279bf867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:08.497717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.500464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.504826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 937/1942] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:08 2022] DELETE /identity/v3/projects/cea270975d1d49d2b00c9408279bf867 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:08.508414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:08.510980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:08.575307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a443b32706b6454ca2726c773e12aeee', 'request_id': 'req-fee221de-9be1-40d4-a540-3b38b832f8c9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.587044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a443b32706b6454ca2726c773e12aeee', 'request_id': 'req-fee221de-9be1-40d4-a540-3b38b832f8c9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.595898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a443b32706b6454ca2726c773e12aeee', 'request_id': 'req-fee221de-9be1-40d4-a540-3b38b832f8c9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.611284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] The token cache is being invalidate because project a443b32706b6454ca2726c773e12aeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:08.611583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.612377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-fee221de-9be1-40d4-a540-3b38b832f8c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.617391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1006/1943] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:08 2022] DELETE /identity/v3/projects/a443b32706b6454ca2726c773e12aeee => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:08.619945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb8f1-e7a0-4958-b7ed-d284d0d5e02f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:08.620424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb8f1-e7a0-4958-b7ed-d284d0d5e02f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:08.620717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb8f1-e7a0-4958-b7ed-d284d0d5e02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:08.655633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5fd9-5351-4fd8-b11d-56a9eb34ed82 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:08.662866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-378eb8f1-e7a0-4958-b7ed-d284d0d5e02f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:08.665294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-378eb8f1-e7a0-4958-b7ed-d284d0d5e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:08.673719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:08.757187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:08.758724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:08.759187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:08.759478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] PATH_INFO: `/v3/users/52e925ae516c4b279eb8f54c3ff55af8` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:08.761005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e925ae516c4b279eb8f54c3ff55af8)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:08.765106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:08.808989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1007/1944] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:08.817412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7a896-2cf7-48c0-9f3a-009976ea6b99 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:08.817714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7a896-2cf7-48c0-9f3a-009976ea6b99 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:08.817998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7a896-2cf7-48c0-9f3a-009976ea6b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:08.832735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e925ae516c4b279eb8f54c3ff55af8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.837193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-37a7a896-2cf7-48c0-9f3a-009976ea6b99 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:08.838413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-37a7a896-2cf7-48c0-9f3a-009976ea6b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:08.842203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e925ae516c4b279eb8f54c3ff55af8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.850117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1008/1945] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:08.853825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e925ae516c4b279eb8f54c3ff55af8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.854471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7a896-2cf7-48c0-9f3a-009976ea6b99 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:08.855145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e925ae516c4b279eb8f54c3ff55af8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.855814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e925ae516c4b279eb8f54c3ff55af8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:08.876463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7a896-2cf7-48c0-9f3a-009976ea6b99 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:08.881947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:08.882432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:08.882796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:08.883205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:08.883771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 938/1946] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:08 2022] DELETE /identity/v3/users/52e925ae516c4b279eb8f54c3ff55af8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:08.884233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:08.884312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:08.886005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:08.905772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1009/1947] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:47:08.907955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:08.910070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:08.935467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:09.013358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448cf3-7190-4f08-b10d-edcbf69d070f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.019440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.020140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.020431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.020710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.023162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.025679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.063730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 939/1948] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:08 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:09.067513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.078627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91661d-5c47-4b03-ae57-90bd1e4b9810 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.143268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.144387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.144387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.144610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.145299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.147325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.175741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1010/1949] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:09.176661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.187400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b638e6-87a4-4d57-89c6-25423f43734f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.192644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.193417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.193774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.194128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.194963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.196554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.207930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 940/1950] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:47:09.213609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.227143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc29230-a70a-44c3-9a8b-35110839f2a3 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.237017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.238896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:09.241056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.243754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.244273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.244656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.245514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.247620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.257375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c233-1bcb-4f42-a780-be9a2af1d65d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.262625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1011/1951] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:47:09.266027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.267403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.267713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.268389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] PATH_INFO: `/v3/projects/9d2b5c18663447e0b1d55896c07101f1` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.268830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.272200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2b5c18663447e0b1d55896c07101f1)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.274126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.280900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bac4-069f-4ded-8ea9-3dea080b7990 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.295073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f55de0-cd6b-47f2-a5b9-d7ca0a9d27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.299692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f55de0-cd6b-47f2-a5b9-d7ca0a9d27ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.300789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f55de0-cd6b-47f2-a5b9-d7ca0a9d27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.301155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f55de0-cd6b-47f2-a5b9-d7ca0a9d27ca admin admin] PATH_INFO: `/v3/projects/83346989b132435095e62092e78e273f/users/801a28a3a3f148cf90bb73e4b6bf6b26/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.344320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f55de0-cd6b-47f2-a5b9-d7ca0a9d27ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=83346989b132435095e62092e78e273f, user_id=801a28a3a3f148cf90bb73e4b6bf6b26, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.349432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f55de0-cd6b-47f2-a5b9-d7ca0a9d27ca admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.363770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2b5c18663447e0b1d55896c07101f1', 'request_id': 'req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:09.368401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1012/1952] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:09 2022] PUT /identity/v3/projects/83346989b132435095e62092e78e273f/users/801a28a3a3f148cf90bb73e4b6bf6b26/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:09.383741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.384544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2b5c18663447e0b1d55896c07101f1', 'request_id': 'req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:09.385738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.386024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.394088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2b5c18663447e0b1d55896c07101f1', 'request_id': 'req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:09.408036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] The token cache is being invalidate because project 9d2b5c18663447e0b1d55896c07101f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:09.408547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:09.409383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5cfa6316-3baa-4ad5-8963-f69c6112fdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:09.411640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 941/1953] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:09 2022] DELETE /identity/v3/projects/9d2b5c18663447e0b1d55896c07101f1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:09.417799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4924-f881-41b0-9260-139c029c12bb None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.417799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4924-f881-41b0-9260-139c029c12bb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.417799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4924-f881-41b0-9260-139c029c12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.419695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] MFA Rules not processed for user `801a28a3a3f148cf90bb73e4b6bf6b26`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:09.421324 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:09.437632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-866f4924-f881-41b0-9260-139c029c12bb None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:09.439657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-866f4924-f881-41b0-9260-139c029c12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:09.461545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:09.497396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1013/1954] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:09.503977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.505430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:09.514345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 942/1955] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:09.522147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81125-5814-4872-9132-7ba57193bf08 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.522536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81125-5814-4872-9132-7ba57193bf08 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.522953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81125-5814-4872-9132-7ba57193bf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.546345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-45a81125-5814-4872-9132-7ba57193bf08 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:09.548037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-45a81125-5814-4872-9132-7ba57193bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:09.556786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 943/1956] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:09.561899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81125-5814-4872-9132-7ba57193bf08 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.576630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81125-5814-4872-9132-7ba57193bf08 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.579095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:09.589466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.590163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.590453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.590742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.594200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:09.596409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.599677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.627311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f9cc3-f97f-4efe-a31f-ecd1bd1af150 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.627824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 944/1957] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:47:09.632115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.639476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.640168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.640460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.640741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.641508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.643529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.651557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73070-513e-40bc-898c-04f3d89de8b1 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.659599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.660447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.660841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.661413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.666066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.668511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.681311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1014/1958] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:09.685301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.729218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 945/1959] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:09.733203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.773516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb44cc-03d3-4114-be8d-14f060eecaf6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.810405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95f44a-deee-4d1f-a7af-1a66eb8c3571 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.815835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.816525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.816814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.817088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.817845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.827190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.858374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 946/1960] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:09.864114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.865167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.866017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.866410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.866795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.867699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.869777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.874980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287501-3b02-4c92-b6e5-754f6e7d35ae admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.880605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.881327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.881622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.882018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.882636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.884455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.887345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:09.900532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1015/1961] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:09 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:09.900730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 947/1962] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:09.901204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.901614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.912267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbd0d1-c3b9-414f-878c-e2a2818cb9b5 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.913638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6565a-7c64-4857-ab94-d5d6a563e5d6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.917222 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.917944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.918301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.918649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.918862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.920589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.920716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.920716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.920716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.921609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.931168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:09.932943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:09.938955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 948/1963] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:47:09.941601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.949789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1016/1964] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:09.952588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:09.967361 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715a1d-3910-4a17-9067-58ec34fcc9e8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.967922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a667e7-e1a4-4c57-bed5-288bd381d923 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:09.975219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.976345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee8fbd-2b7a-441a-aaba-a8dea9bfbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:09.977050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.977267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8fbd-2b7a-441a-aaba-a8dea9bfbca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:09.977557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8fbd-2b7a-441a-aaba-a8dea9bfbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.977800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:09.977910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8fbd-2b7a-441a-aaba-a8dea9bfbca5 admin admin] PATH_INFO: `/v3/projects/2efcf824763b4dd7a199f729eac92dfc/users/cdc9854a67ca448f865b9fc10588677a/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:09.983268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] PATH_INFO: `/v3/projects/e2b889c720e246589e8eb632ebbb5785/users/3c051b5b51ff40a49c65a17b9c8b78e5/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.010568 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee8fbd-2b7a-441a-aaba-a8dea9bfbca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efcf824763b4dd7a199f729eac92dfc, user_id=cdc9854a67ca448f865b9fc10588677a, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.013311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee8fbd-2b7a-441a-aaba-a8dea9bfbca5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.033045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 949/1965] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:09 2022] PUT /identity/v3/projects/2efcf824763b4dd7a199f729eac92dfc/users/cdc9854a67ca448f865b9fc10588677a/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:10.033543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b889c720e246589e8eb632ebbb5785, user_id=3c051b5b51ff40a49c65a17b9c8b78e5, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.040379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.045074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a215f-8615-4299-a5d9-de2ac9593708 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.045315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a215f-8615-4299-a5d9-de2ac9593708 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.045598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a215f-8615-4299-a5d9-de2ac9593708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.094649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-366a215f-8615-4299-a5d9-de2ac9593708 None None] MFA Rules not processed for user `cdc9854a67ca448f865b9fc10588677a`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:10.095566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1017/1966] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:09 2022] PUT /identity/v3/projects/e2b889c720e246589e8eb632ebbb5785/users/3c051b5b51ff40a49c65a17b9c8b78e5/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:10.096379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-366a215f-8615-4299-a5d9-de2ac9593708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:10.102965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.248195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:10.258594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 950/1967] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:10.264630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a215f-8615-4299-a5d9-de2ac9593708 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.282750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d3af8-2f2c-4c9a-a9fe-4dd48638dcca admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.285620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a215f-8615-4299-a5d9-de2ac9593708 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.288628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.289569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.290103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.290529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.291265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.291626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.292131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.292549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.292928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.293735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.294191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.298137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.309293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1018/1968] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:10.313918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.326549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779532-e8d7-4c8f-9957-14dfc1b10dee admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.334697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fdd49-33cf-4385-bcd9-0ac7f7eb300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.335930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fdd49-33cf-4385-bcd9-0ac7f7eb300f admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.336291 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fdd49-33cf-4385-bcd9-0ac7f7eb300f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.336651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fdd49-33cf-4385-bcd9-0ac7f7eb300f admin admin] PATH_INFO: `/v3/projects/e2b889c720e246589e8eb632ebbb5785/users/3c051b5b51ff40a49c65a17b9c8b78e5/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.338871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fdd49-33cf-4385-bcd9-0ac7f7eb300f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b889c720e246589e8eb632ebbb5785, user_id=3c051b5b51ff40a49c65a17b9c8b78e5, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.341651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fdd49-33cf-4385-bcd9-0ac7f7eb300f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.355243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1019/1969] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:10 2022] PUT /identity/v3/projects/e2b889c720e246589e8eb632ebbb5785/users/3c051b5b51ff40a49c65a17b9c8b78e5/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:10.366657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 951/1970] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:10 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:10.366851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a304de8-8aa6-4538-bd9c-fdf7ad2729dd None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.366985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a304de8-8aa6-4538-bd9c-fdf7ad2729dd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.367906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a304de8-8aa6-4538-bd9c-fdf7ad2729dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.369417 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.398281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4a304de8-8aa6-4538-bd9c-fdf7ad2729dd None None] MFA Rules not processed for user `3c051b5b51ff40a49c65a17b9c8b78e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:10.399618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4a304de8-8aa6-4538-bd9c-fdf7ad2729dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:10.447891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a161ac-5d86-4947-905b-d1a767670433 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.455325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.456245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.456504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.456798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.457544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.459512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.482177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1020/1971] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:10.485528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 952/1972] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:10 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:10.489285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a304de8-8aa6-4538-bd9c-fdf7ad2729dd None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.497021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.499539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:10.502187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a304de8-8aa6-4538-bd9c-fdf7ad2729dd None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.511732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.512431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.513290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.513582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.514377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.516276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.534061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1021/1973] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:10.535227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.549113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aea1ef-058c-4faf-86a8-595bede71056 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.554524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.555475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.555768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.556056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] PATH_INFO: `/v3/projects/b5a1900bba47476c87c07b01b1c7c92f/users/3a4b4e6acb944f7383873767cd96bab6/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.570855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1d13-20ed-4e4c-b8c9-bde989303389 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.572581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a1900bba47476c87c07b01b1c7c92f, user_id=3a4b4e6acb944f7383873767cd96bab6, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.574767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.575531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.575650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.576095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.576455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.578806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:10.586897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.588475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.595369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1022/1974] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:10 2022] PUT /identity/v3/projects/b5a1900bba47476c87c07b01b1c7c92f/users/3a4b4e6acb944f7383873767cd96bab6/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:10.599194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.599332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 953/1975] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:10.676246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.679510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cdf61-0c12-469c-809e-0b949b3df391 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.685342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5803220-2d3f-40fa-8fb4-64990e8a8505 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.689669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.690483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.690848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.691436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.692303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.694013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.709543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1023/1976] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:47:10.713623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.725921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91f66f-de92-483d-94a3-3350f2d94fb5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:10.730860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500faab6-1877-4c71-9822-008541b89321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.731812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500faab6-1877-4c71-9822-008541b89321 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.732105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500faab6-1877-4c71-9822-008541b89321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.732394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500faab6-1877-4c71-9822-008541b89321 admin admin] PATH_INFO: `/v3/projects/b5a1900bba47476c87c07b01b1c7c92f/users/3a4b4e6acb944f7383873767cd96bab6/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.735720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500faab6-1877-4c71-9822-008541b89321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a1900bba47476c87c07b01b1c7c92f, user_id=3a4b4e6acb944f7383873767cd96bab6, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.738880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500faab6-1877-4c71-9822-008541b89321 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.752226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1024/1977] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:10 2022] PUT /identity/v3/projects/b5a1900bba47476c87c07b01b1c7c92f/users/3a4b4e6acb944f7383873767cd96bab6/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:10.760177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:10.761135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.761484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.761846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.762062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8714-6331-4bca-87ad-7f92d352c516 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:10.762441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8714-6331-4bca-87ad-7f92d352c516 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:10.762981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8714-6331-4bca-87ad-7f92d352c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:10.790206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:10.795319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ea3f8714-6331-4bca-87ad-7f92d352c516 None None] MFA Rules not processed for user `3a4b4e6acb944f7383873767cd96bab6`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:10.796809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ea3f8714-6331-4bca-87ad-7f92d352c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:10.837936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:10.837936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:10.851270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 954/1978] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:47:10.932176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1025/1979] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:10.953428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:10.955219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:10.973850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da42e6-b1ca-4d5c-b92e-6256c321f2aa service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:11.077849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:11.079040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:11.079882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:11.080904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:11.100438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:11.101905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:11.115684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 955/1980] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:11.283598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8714-6331-4bca-87ad-7f92d352c516 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:11.294052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:11.305098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5725-a36b-418c-8460-b9ea80a36308 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:11.315345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28707261-d5dc-4ecd-aef8-2b2a9e6de145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:11.316105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707261-d5dc-4ecd-aef8-2b2a9e6de145 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:11.316469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707261-d5dc-4ecd-aef8-2b2a9e6de145 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:11.316826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707261-d5dc-4ecd-aef8-2b2a9e6de145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:11.410025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8714-6331-4bca-87ad-7f92d352c516 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:11.416499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:11.417635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:11.418178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:11.418689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] PATH_INFO: `/v3/users/801a28a3a3f148cf90bb73e4b6bf6b26` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:11.420737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=801a28a3a3f148cf90bb73e4b6bf6b26)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:11.423557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:11.431422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:11.448046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707261-d5dc-4ecd-aef8-2b2a9e6de145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:11.449514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707261-d5dc-4ecd-aef8-2b2a9e6de145 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:11.467849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 956/1981] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:11.519330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801a28a3a3f148cf90bb73e4b6bf6b26'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:11.533999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801a28a3a3f148cf90bb73e4b6bf6b26'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:11.534754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801a28a3a3f148cf90bb73e4b6bf6b26'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:11.546704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801a28a3a3f148cf90bb73e4b6bf6b26'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:11.576096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801a28a3a3f148cf90bb73e4b6bf6b26'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:11.584195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1026/1982] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:11 2022] DELETE /identity/v3/users/801a28a3a3f148cf90bb73e4b6bf6b26 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:11.589905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:11.590317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:11.590781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:11.634558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:11.635735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:11.827674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 957/1983] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:11.837301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:11.838751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:11.905659 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4aee4-dc3f-4493-9662-0609ba74e25c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:11.911861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:11.912626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:11.912914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:11.913196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:11.925436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:11.927023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:11.947114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1027/1984] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:12.726235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:12.727842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:12.751531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9d6c-171c-4276-bad6-9ebc7039315d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:12.766246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:12.767971 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:12.768265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:12.768554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] PATH_INFO: `/v3/projects/83346989b132435095e62092e78e273f` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:12.769787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83346989b132435095e62092e78e273f)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:12.771805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:12.773522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:12.838826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83346989b132435095e62092e78e273f', 'request_id': 'req-15397219-6cbc-4428-bff8-d26c669d7925'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:12.849243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83346989b132435095e62092e78e273f', 'request_id': 'req-15397219-6cbc-4428-bff8-d26c669d7925'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:12.866576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83346989b132435095e62092e78e273f', 'request_id': 'req-15397219-6cbc-4428-bff8-d26c669d7925'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:12.879931 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] The token cache is being invalidate because project 83346989b132435095e62092e78e273f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:12.880229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:12.881098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:12.886589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 958/1985] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:12 2022] DELETE /identity/v3/projects/83346989b132435095e62092e78e273f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:12.887819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:12.900932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2849b2-d737-4d45-9644-d32e75b8378d service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:12.970708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:12.971656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:12.971943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:12.972223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] PATH_INFO: `/v3/users/3c051b5b51ff40a49c65a17b9c8b78e5` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:12.974080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c051b5b51ff40a49c65a17b9c8b78e5)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:12.976072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:13.013931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:13.038531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c051b5b51ff40a49c65a17b9c8b78e5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.050447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c051b5b51ff40a49c65a17b9c8b78e5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.051531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c051b5b51ff40a49c65a17b9c8b78e5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.060669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c051b5b51ff40a49c65a17b9c8b78e5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.080395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-83d80d62-03f3-47e8-abb6-11a0c54671ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c051b5b51ff40a49c65a17b9c8b78e5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.088103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1028/1986] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:12 2022] DELETE /identity/v3/users/3c051b5b51ff40a49c65a17b9c8b78e5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:13.538059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:13.539665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:13.571452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15397219-6cbc-4428-bff8-d26c669d7925 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:13.722503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:13.723428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:13.723715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:13.723997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] PATH_INFO: `/v3/projects/e2b889c720e246589e8eb632ebbb5785` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:13.725644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b889c720e246589e8eb632ebbb5785)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:13.727175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:13.812764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b889c720e246589e8eb632ebbb5785', 'request_id': 'req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.829984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b889c720e246589e8eb632ebbb5785', 'request_id': 'req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.845705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b889c720e246589e8eb632ebbb5785', 'request_id': 'req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.862686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] The token cache is being invalidate because project e2b889c720e246589e8eb632ebbb5785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:13.863066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.863727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90e2e4b7-4c77-4f5d-ab12-6010baaf8014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:13.866069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 959/1987] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:13 2022] DELETE /identity/v3/projects/e2b889c720e246589e8eb632ebbb5785 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:13.870576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7fc4e-0009-4592-9941-3d7c7b4d986c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:13.870958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7fc4e-0009-4592-9941-3d7c7b4d986c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:13.872781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7fc4e-0009-4592-9941-3d7c7b4d986c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:13.893490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a4c7fc4e-0009-4592-9941-3d7c7b4d986c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:13.895067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a4c7fc4e-0009-4592-9941-3d7c7b4d986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:13.991535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1029/1988] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:13.999216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65cf1c-6095-4383-b07e-378bffc09244 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.000141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65cf1c-6095-4383-b07e-378bffc09244 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.000141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65cf1c-6095-4383-b07e-378bffc09244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.019492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-df65cf1c-6095-4383-b07e-378bffc09244 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:14.021444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-df65cf1c-6095-4383-b07e-378bffc09244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:14.033942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 960/1989] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:14.035414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7fc4e-0009-4592-9941-3d7c7b4d986c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:14.046608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7fc4e-0009-4592-9941-3d7c7b4d986c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:14.051531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:14.052135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.052665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.052785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.053430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:14.053744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:14.055391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:14.070576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1030/1990] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:47:14.075062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65cf1c-6095-4383-b07e-378bffc09244 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:14.085740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65cf1c-6095-4383-b07e-378bffc09244 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:14.092717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:14.093677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.093677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.093958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.094706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:14.096709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:14.110249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:14.133386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 961/1991] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:14 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:14.134683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:14.147638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364362c-9651-43a1-923e-42e3d272473d admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:14.222342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:14.224947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.224947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.224947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.224947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:14.226806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:14.253826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1031/1992] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:14 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:14.257378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:14.269673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25eea-3c93-4fc0-b796-5e60c62b5895 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:14.276032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:14.277363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.277677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.277957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.278692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:14.281104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:14.306595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 962/1993] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:14.310345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:14.328919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc225-b842-451e-85a8-3443b943ccc2 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:14.338167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de16d7-efbf-4c82-b5ea-c2eabdea560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:14.338880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de16d7-efbf-4c82-b5ea-c2eabdea560f admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.339272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de16d7-efbf-4c82-b5ea-c2eabdea560f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.339486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de16d7-efbf-4c82-b5ea-c2eabdea560f admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.340383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de16d7-efbf-4c82-b5ea-c2eabdea560f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:14.343443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de16d7-efbf-4c82-b5ea-c2eabdea560f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:14.356448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1032/1994] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:14.361154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:14.374800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21f7a5-c2a9-4e07-8ecd-664ed0d610e5 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:14.387764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:14.388874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.389345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.389706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] PATH_INFO: `/v3/projects/3804e89a75f04b1a8acbe48b582c58d6/users/2d2e57fdb86c4c428152e68fb2bfa88e/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.412858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3804e89a75f04b1a8acbe48b582c58d6, user_id=2d2e57fdb86c4c428152e68fb2bfa88e, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:14.416710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:14.472175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 963/1995] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:14 2022] PUT /identity/v3/projects/3804e89a75f04b1a8acbe48b582c58d6/users/2d2e57fdb86c4c428152e68fb2bfa88e/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:14.484564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.484564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.484564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.530459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:14.552425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] MFA Rules not processed for user `2d2e57fdb86c4c428152e68fb2bfa88e`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:14.554002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:14.709081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1033/1996] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:14.728448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:14.730345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:14.852420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a996e-e7d0-4d75-954b-65184af1126e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:14.857709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9fe9a-7932-4df8-8eef-542dec05d054 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880c7a0632ef44a1ab446d1bb53399fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:14.858703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9fe9a-7932-4df8-8eef-542dec05d054 service glance] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:14.859201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9fe9a-7932-4df8-8eef-542dec05d054 service glance] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:14.859565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9fe9a-7932-4df8-8eef-542dec05d054 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:14.872002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9fe9a-7932-4df8-8eef-542dec05d054 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:14.874356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9fe9a-7932-4df8-8eef-542dec05d054 service glance] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:14.888761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 964/1997] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:47:24.705346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=27 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:24.881267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:29.298590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:29.300074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:29.372365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41865b3-dd8f-4c17-8a8b-70a9d4d14620 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:29.377241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:29.378139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:29.378432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:29.378715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] PATH_INFO: `/v3/users/cdc9854a67ca448f865b9fc10588677a` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:29.380039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc9854a67ca448f865b9fc10588677a)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:29.382332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:29.433372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc9854a67ca448f865b9fc10588677a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:29.441794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc9854a67ca448f865b9fc10588677a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:29.442419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc9854a67ca448f865b9fc10588677a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:29.449563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc9854a67ca448f865b9fc10588677a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:29.462479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc9854a67ca448f865b9fc10588677a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:29.468677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1034/1998] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:29 2022] DELETE /identity/v3/users/cdc9854a67ca448f865b9fc10588677a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:29.473143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:29.473607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:29.473750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:29.493414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:29.494697 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:29.564279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 965/1999] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:29.574590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:29.576910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:29.638265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e63b-9b69-4d15-bf15-e94bb737fc48 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:29.652129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:29.652129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:29.652129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:29.652129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:29.671265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:29.676340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:29.685960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1035/2000] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:29.967455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:29.968913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:29.983280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63446622-2338-4245-8a5b-632f06b2a06e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:29.988774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:29.989843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:29.990145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:29.990487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] PATH_INFO: `/v3/projects/2efcf824763b4dd7a199f729eac92dfc` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:29.991661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efcf824763b4dd7a199f729eac92dfc)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:29.993577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:30.040873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efcf824763b4dd7a199f729eac92dfc', 'request_id': 'req-f1ae3686-184b-4d3b-a622-24255742e3d0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.049856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efcf824763b4dd7a199f729eac92dfc', 'request_id': 'req-f1ae3686-184b-4d3b-a622-24255742e3d0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.055251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efcf824763b4dd7a199f729eac92dfc', 'request_id': 'req-f1ae3686-184b-4d3b-a622-24255742e3d0'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.066891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] The token cache is being invalidate because project 2efcf824763b4dd7a199f729eac92dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:30.067287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.068030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.069942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 966/2001] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:29 2022] DELETE /identity/v3/projects/2efcf824763b4dd7a199f729eac92dfc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:30.073669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:30.083880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a08131-044c-4508-a850-4d0f89b4c1ae service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:30.102293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:30.143140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:30.144011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.144294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.144569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] PATH_INFO: `/v3/users/3a4b4e6acb944f7383873767cd96bab6` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.145740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4b4e6acb944f7383873767cd96bab6)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:30.147730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:30.192102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4b4e6acb944f7383873767cd96bab6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.199339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4b4e6acb944f7383873767cd96bab6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.200047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4b4e6acb944f7383873767cd96bab6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.208538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4b4e6acb944f7383873767cd96bab6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.220727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-04cad12c-c47d-40f3-98c9-2dbc87280f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4b4e6acb944f7383873767cd96bab6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.226635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1036/2002] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:30 2022] DELETE /identity/v3/users/3a4b4e6acb944f7383873767cd96bab6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:30.490519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:30.492527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:30.505875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3686-184b-4d3b-a622-24255742e3d0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:30.563415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:30.564347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.564631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.564914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] PATH_INFO: `/v3/projects/b5a1900bba47476c87c07b01b1c7c92f` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.566149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a1900bba47476c87c07b01b1c7c92f)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:30.568508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:30.600247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:30.618581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a1900bba47476c87c07b01b1c7c92f', 'request_id': 'req-67049cc6-0af3-40fd-87a7-60a0aabea1fc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.625924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a1900bba47476c87c07b01b1c7c92f', 'request_id': 'req-67049cc6-0af3-40fd-87a7-60a0aabea1fc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.631658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a1900bba47476c87c07b01b1c7c92f', 'request_id': 'req-67049cc6-0af3-40fd-87a7-60a0aabea1fc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.643203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] The token cache is being invalidate because project b5a1900bba47476c87c07b01b1c7c92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:30.643494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.644144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67049cc6-0af3-40fd-87a7-60a0aabea1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:30.645708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 967/2003] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:30 2022] DELETE /identity/v3/projects/b5a1900bba47476c87c07b01b1c7c92f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:30.650721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5d5d-0af8-4267-8824-991166048c11 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.651489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5d5d-0af8-4267-8824-991166048c11 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.651704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5d5d-0af8-4267-8824-991166048c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.670028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-761f5d5d-0af8-4267-8824-991166048c11 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:30.671185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-761f5d5d-0af8-4267-8824-991166048c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:30.733316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1037/2004] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:30.741765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1635d0-8d50-48f8-9a0a-ba098391c9c2 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.742062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1635d0-8d50-48f8-9a0a-ba098391c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.742351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1635d0-8d50-48f8-9a0a-ba098391c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.760658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bc1635d0-8d50-48f8-9a0a-ba098391c9c2 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:30.761852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bc1635d0-8d50-48f8-9a0a-ba098391c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:30.770612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 968/2005] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:30.774651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f5d5d-0af8-4267-8824-991166048c11 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:30.784340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f5d5d-0af8-4267-8824-991166048c11 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:30.789358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:30.790017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.790305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.790587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.791348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:30.791661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:30.793263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:30.805283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1038/2006] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:47:30.809498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1635d0-8d50-48f8-9a0a-ba098391c9c2 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:30.819269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1635d0-8d50-48f8-9a0a-ba098391c9c2 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:30.823874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:30.824524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.824813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.825096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.825796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:30.827757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:30.855085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 969/2007] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:30 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:30.856167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:30.866708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2307a8-0a4c-475e-887c-a2f80ccde7e4 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:30.894218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:30.927169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:30.927779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.928070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.928351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.929080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:30.931024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:30.951307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1039/2008] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:30 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:30.955785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:30.966530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3639-3bde-403d-8ce7-5fbe4180c34f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:30.971855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:30.972527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:30.972813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:30.973093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:30.973822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:30.975438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:30.986320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 970/2009] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:30.990283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.000237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694cec-144e-4439-b5e1-2a5fca5379e2 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.004830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e437b-39c0-45b4-87b4-3108bfeeb510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.005489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e437b-39c0-45b4-87b4-3108bfeeb510 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.005782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e437b-39c0-45b4-87b4-3108bfeeb510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.006066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e437b-39c0-45b4-87b4-3108bfeeb510 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.006834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e437b-39c0-45b4-87b4-3108bfeeb510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.008458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e437b-39c0-45b4-87b4-3108bfeeb510 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.018707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1040/2010] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:31.022717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.032987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18379-d8b7-4358-9eb9-0b346bec22d0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.038003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.038888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.039207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.039492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] PATH_INFO: `/v3/projects/e94f753c267342868c7a0c3b3c79ce7c/users/a695b916e7974abc9fb8c244e1a41f4a/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.055335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94f753c267342868c7a0c3b3c79ce7c, user_id=a695b916e7974abc9fb8c244e1a41f4a, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.058089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.071746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 971/2011] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:31 2022] PUT /identity/v3/projects/e94f753c267342868c7a0c3b3c79ce7c/users/a695b916e7974abc9fb8c244e1a41f4a/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:31.081815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b2fae-3ba6-41c1-a9f8-2d8f4f93d398 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.082112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b2fae-3ba6-41c1-a9f8-2d8f4f93d398 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.082393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b2fae-3ba6-41c1-a9f8-2d8f4f93d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.108347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ae4b2fae-3ba6-41c1-a9f8-2d8f4f93d398 None None] MFA Rules not processed for user `a695b916e7974abc9fb8c244e1a41f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:31.110096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ae4b2fae-3ba6-41c1-a9f8-2d8f4f93d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:31.173732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1041/2012] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:31.178560 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.239225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1bed9-72e4-4b4f-8177-3aef296e4dce admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.243905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.244570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.244861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.245143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.245832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.247761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.272648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 972/2013] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:31 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:31.276814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b2fae-3ba6-41c1-a9f8-2d8f4f93d398 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.287703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b2fae-3ba6-41c1-a9f8-2d8f4f93d398 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.342923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.343609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.343894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.344174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.344855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.346766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.365981 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1042/2014] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:31 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:31.369880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.380604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde50110-2874-43a5-b7f6-ca6eea5ec7c8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.385335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.386042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.386337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.386622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.387399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.389092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.400191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 973/2015] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:31.403992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.414064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c022a-2902-4e4f-8d35-9aa32b88114f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.418634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.419546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.419836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.420116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] PATH_INFO: `/v3/projects/3bca7e541e7c43f9ba15792b3a2ad300/users/a04303ab4eaf43feb652dbe87c57656b/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.434418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bca7e541e7c43f9ba15792b3a2ad300, user_id=a04303ab4eaf43feb652dbe87c57656b, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.437047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.450262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1043/2016] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:31 2022] PUT /identity/v3/projects/3bca7e541e7c43f9ba15792b3a2ad300/users/a04303ab4eaf43feb652dbe87c57656b/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:31.454172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.464186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e52dc-1adf-4f69-9b0c-531aef0482a8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.483827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:31.523188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03053b67-666d-4da8-ba1d-5f3d41e55922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.523862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053b67-666d-4da8-ba1d-5f3d41e55922 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.524140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053b67-666d-4da8-ba1d-5f3d41e55922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.524419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053b67-666d-4da8-ba1d-5f3d41e55922 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.525141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03053b67-666d-4da8-ba1d-5f3d41e55922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.526733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03053b67-666d-4da8-ba1d-5f3d41e55922 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.536818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 974/2017] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:31.541457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.546886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:31.553724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2149-4382-467b-9d97-d8319dc4f121 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.558533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.559450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.559738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.560015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] PATH_INFO: `/v3/projects/3bca7e541e7c43f9ba15792b3a2ad300/users/a04303ab4eaf43feb652dbe87c57656b/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.561964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bca7e541e7c43f9ba15792b3a2ad300, user_id=a04303ab4eaf43feb652dbe87c57656b, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.565255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.575674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1044/2018] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:31 2022] PUT /identity/v3/projects/3bca7e541e7c43f9ba15792b3a2ad300/users/a04303ab4eaf43feb652dbe87c57656b/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:31.585582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60c22-fa8c-40c9-8f3e-9c79d4b081a7 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.585877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60c22-fa8c-40c9-8f3e-9c79d4b081a7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.586162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60c22-fa8c-40c9-8f3e-9c79d4b081a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.612915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-56a60c22-fa8c-40c9-8f3e-9c79d4b081a7 None None] MFA Rules not processed for user `a04303ab4eaf43feb652dbe87c57656b`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:31.614123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-56a60c22-fa8c-40c9-8f3e-9c79d4b081a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:31.682235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 975/2019] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:31.693485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:31.695210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:31.752123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efbdb-873d-4e25-803a-dfc2a9b24363 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:31.755877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49c2c-ca78-401a-a2dd-dcd6aa0820df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:31.756506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49c2c-ca78-401a-a2dd-dcd6aa0820df service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:31.756813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49c2c-ca78-401a-a2dd-dcd6aa0820df service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:31.757078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49c2c-ca78-401a-a2dd-dcd6aa0820df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:31.767137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49c2c-ca78-401a-a2dd-dcd6aa0820df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:31.768573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49c2c-ca78-401a-a2dd-dcd6aa0820df service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:31.778167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1045/2020] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:32.164923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60c22-fa8c-40c9-8f3e-9c79d4b081a7 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:32.227434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60c22-fa8c-40c9-8f3e-9c79d4b081a7 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:32.231819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:32.232694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:32.232977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:32.233252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] PATH_INFO: `/v3/users/a695b916e7974abc9fb8c244e1a41f4a` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:32.234430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a695b916e7974abc9fb8c244e1a41f4a)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:32.236368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:32.282434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a695b916e7974abc9fb8c244e1a41f4a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.283639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:32.291146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a695b916e7974abc9fb8c244e1a41f4a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.298556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a695b916e7974abc9fb8c244e1a41f4a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.299208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a695b916e7974abc9fb8c244e1a41f4a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.299830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a695b916e7974abc9fb8c244e1a41f4a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.317402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 976/2021] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:32 2022] DELETE /identity/v3/users/a695b916e7974abc9fb8c244e1a41f4a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:32.321853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:32.322155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:32.322442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:32.339732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:32.340935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:32.399628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1046/2022] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:32.409688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:32.411126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:32.467208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ef862-68fe-49ca-a322-c7b9f1aef260 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:32.471698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:32.472353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:32.472643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:32.472930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:32.481979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:32.483390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:32.493272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 977/2023] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:32.765505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:32.767568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:32.779558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bd057-263d-4286-a08d-46cb195f7a1f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:32.784117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:32.784996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:32.785286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:32.785571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] PATH_INFO: `/v3/projects/e94f753c267342868c7a0c3b3c79ce7c` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:32.786760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94f753c267342868c7a0c3b3c79ce7c)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:32.788966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:32.837766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94f753c267342868c7a0c3b3c79ce7c', 'request_id': 'req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.845179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94f753c267342868c7a0c3b3c79ce7c', 'request_id': 'req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.851260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94f753c267342868c7a0c3b3c79ce7c', 'request_id': 'req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.862355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] The token cache is being invalidate because project e94f753c267342868c7a0c3b3c79ce7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:32.862644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.863321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.864867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1047/2024] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:32 2022] DELETE /identity/v3/projects/e94f753c267342868c7a0c3b3c79ce7c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:32.868803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:32.879077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5719-6fc8-4d05-b4a6-72e35e140a1c service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:32.933915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:32.934827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:32.935144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:32.935423 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] PATH_INFO: `/v3/users/a04303ab4eaf43feb652dbe87c57656b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:32.936597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04303ab4eaf43feb652dbe87c57656b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:32.939106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:32.983843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04303ab4eaf43feb652dbe87c57656b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.990703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04303ab4eaf43feb652dbe87c57656b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.997632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04303ab4eaf43feb652dbe87c57656b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.998254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04303ab4eaf43feb652dbe87c57656b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:32.998863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a7cf464e-93f9-470d-8a7c-a87df163d5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04303ab4eaf43feb652dbe87c57656b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:33.004490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:33.018218 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 978/2025] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:32 2022] DELETE /identity/v3/users/a04303ab4eaf43feb652dbe87c57656b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:33.302878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:33.304437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:33.318029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32949e-3e5b-4b7a-9d7d-421b40dc4fb6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:33.330404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:33.380519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:33.381407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.381702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.382016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] PATH_INFO: `/v3/projects/3bca7e541e7c43f9ba15792b3a2ad300` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.383256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bca7e541e7c43f9ba15792b3a2ad300)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:33.385175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:33.431188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bca7e541e7c43f9ba15792b3a2ad300', 'request_id': 'req-c1439461-ec2f-4816-a3cc-7863ba3d8199'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:33.439396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bca7e541e7c43f9ba15792b3a2ad300', 'request_id': 'req-c1439461-ec2f-4816-a3cc-7863ba3d8199'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:33.445215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bca7e541e7c43f9ba15792b3a2ad300', 'request_id': 'req-c1439461-ec2f-4816-a3cc-7863ba3d8199'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:33.456236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] The token cache is being invalidate because project 3bca7e541e7c43f9ba15792b3a2ad300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:33.456528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:33.457168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1439461-ec2f-4816-a3cc-7863ba3d8199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:33.458728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1048/2026] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:33 2022] DELETE /identity/v3/projects/3bca7e541e7c43f9ba15792b3a2ad300 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:33.463722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4c683-721b-401d-8539-f51e86c6e21d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.464021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4c683-721b-401d-8539-f51e86c6e21d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.464308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4c683-721b-401d-8539-f51e86c6e21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.483200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6dd4c683-721b-401d-8539-f51e86c6e21d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:33.484416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6dd4c683-721b-401d-8539-f51e86c6e21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:33.545773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 979/2027] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:33.554560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6c80c-6596-4817-99d8-f6aa0972e6c0 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.554885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6c80c-6596-4817-99d8-f6aa0972e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.555226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6c80c-6596-4817-99d8-f6aa0972e6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.574199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-23e6c80c-6596-4817-99d8-f6aa0972e6c0 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:33.575429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-23e6c80c-6596-4817-99d8-f6aa0972e6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:33.584229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1049/2028] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:33.588665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4c683-721b-401d-8539-f51e86c6e21d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:33.598575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4c683-721b-401d-8539-f51e86c6e21d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:33.603233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:33.603907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.604198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.604483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.605220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:33.605534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:33.607186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:33.618650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 980/2029] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:47:33.623181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6c80c-6596-4817-99d8-f6aa0972e6c0 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:33.633148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6c80c-6596-4817-99d8-f6aa0972e6c0 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:33.637911 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:33.638604 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.638900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.639219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.639931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:33.641977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:33.669078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1050/2030] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:33 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:33.673543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:33.683446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35661-6904-43f6-9ad9-8b806300736d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:33.744061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:33.744751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.745042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.745324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.746035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:33.748022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:33.772859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 981/2031] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:33 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:33.774159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:33.785092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3962e5-64fe-4b4d-8d7f-8ca60d774852 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:33.789968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:33.790629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.790943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.791224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.791955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:33.793556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:33.806477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1051/2032] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:33.810349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:33.820358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071115ea-2f71-486b-8534-e9669417968a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:33.825213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b37bd-c7c3-4f31-8e11-e63b7cb9540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:33.825885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b37bd-c7c3-4f31-8e11-e63b7cb9540b admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.826176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b37bd-c7c3-4f31-8e11-e63b7cb9540b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.826461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b37bd-c7c3-4f31-8e11-e63b7cb9540b admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.827244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b37bd-c7c3-4f31-8e11-e63b7cb9540b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:33.829351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b37bd-c7c3-4f31-8e11-e63b7cb9540b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:33.839708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 982/2033] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:33.843730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:33.854140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5c3e3-b4e2-4f62-b93e-84a45bbe3aeb admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:33.859204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:33.860108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.860488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.860695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] PATH_INFO: `/v3/projects/882608f030174ab8bbc28218615ce6eb/users/5fc8fa9db011420cb71ac25a208e4128/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.875869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882608f030174ab8bbc28218615ce6eb, user_id=5fc8fa9db011420cb71ac25a208e4128, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:33.878590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:33.897238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1052/2034] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:33 2022] PUT /identity/v3/projects/882608f030174ab8bbc28218615ce6eb/users/5fc8fa9db011420cb71ac25a208e4128/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:33.908036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a939b68-240d-4150-ad96-bab3ed4e825e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:33.908501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a939b68-240d-4150-ad96-bab3ed4e825e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:33.908590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a939b68-240d-4150-ad96-bab3ed4e825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:33.935684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6a939b68-240d-4150-ad96-bab3ed4e825e None None] MFA Rules not processed for user `5fc8fa9db011420cb71ac25a208e4128`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:33.936897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6a939b68-240d-4150-ad96-bab3ed4e825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:33.977619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:34.001246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 983/2035] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:34.005861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.051350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:34.071363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06d2fa-36da-43ed-8c8c-7f4941a0ad92 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.076014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.076686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.076978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.077266 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.077977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.079941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.105990 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1053/2036] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:34 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:34.110605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a939b68-240d-4150-ad96-bab3ed4e825e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.121617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a939b68-240d-4150-ad96-bab3ed4e825e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.179908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.180598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.181052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.181159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.181890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.183952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.204594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 984/2037] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:34 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:47:34.208707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.219791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ce40d-10f2-481e-b839-db5671d1a5db admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.224499 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.225176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.225468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.225757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.226502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.228145 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.239852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1054/2038] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:34.244192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.254650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a6ff-bf86-4b3c-b7d9-b526844d55a7 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.261502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.262415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.262710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.263035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] PATH_INFO: `/v3/projects/307cda824736421cb103fed7f9ec9e23/users/c494716c422b42998ab97acb73349601/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.278811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307cda824736421cb103fed7f9ec9e23, user_id=c494716c422b42998ab97acb73349601, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.282051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.298002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 985/2039] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:34 2022] PUT /identity/v3/projects/307cda824736421cb103fed7f9ec9e23/users/c494716c422b42998ab97acb73349601/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:34.301864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.312276 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971b9b-0f73-4628-b005-fd7973c868d6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.372139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a089cac-17fb-4460-bd8a-c3ea82f638c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.372819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089cac-17fb-4460-bd8a-c3ea82f638c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.373250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089cac-17fb-4460-bd8a-c3ea82f638c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.373542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089cac-17fb-4460-bd8a-c3ea82f638c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.374486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a089cac-17fb-4460-bd8a-c3ea82f638c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.376465 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a089cac-17fb-4460-bd8a-c3ea82f638c3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.390725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1055/2040] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:34.391925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.402436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ed1cf-f868-4ff2-9e96-cd623bc580d2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.407736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.408649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.408944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.409227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] PATH_INFO: `/v3/projects/307cda824736421cb103fed7f9ec9e23/users/c494716c422b42998ab97acb73349601/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.411584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307cda824736421cb103fed7f9ec9e23, user_id=c494716c422b42998ab97acb73349601, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.414545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.425564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 986/2041] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:34 2022] PUT /identity/v3/projects/307cda824736421cb103fed7f9ec9e23/users/c494716c422b42998ab97acb73349601/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:34.436652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d459c-7e96-4e55-b64d-4121353d5d53 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.436975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d459c-7e96-4e55-b64d-4121353d5d53 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.437265 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d459c-7e96-4e55-b64d-4121353d5d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.463925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-c42d459c-7e96-4e55-b64d-4121353d5d53 None None] MFA Rules not processed for user `c494716c422b42998ab97acb73349601`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:34.465142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c42d459c-7e96-4e55-b64d-4121353d5d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:34.534246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1056/2042] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:34 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:34.546171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.548570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:34.605797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a79b-c1e7-4225-a7fc-34a11acfc017 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.610653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.611351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.611653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.611934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.621565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.623101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.632654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 987/2043] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:34 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:34.702783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d459c-7e96-4e55-b64d-4121353d5d53 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:34.713821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d459c-7e96-4e55-b64d-4121353d5d53 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:34.718264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a3fc-84e5-4586-a483-6e4a2cd8e37c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:34.719575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a3fc-84e5-4586-a483-6e4a2cd8e37c service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:34.719878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a3fc-84e5-4586-a483-6e4a2cd8e37c service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:34.720159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a3fc-84e5-4586-a483-6e4a2cd8e37c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:34.756267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:34.784375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9a3fc-84e5-4586-a483-6e4a2cd8e37c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:34.785909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9a3fc-84e5-4586-a483-6e4a2cd8e37c service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:34.795679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1057/2044] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:34 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:44.628357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:44.791294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=11 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:52.682544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:52.684292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:52.796357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62adf5-8eba-42d3-b47c-3f982a5703cc service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:52.802577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:52.803569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:52.803928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:52.804275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] PATH_INFO: `/v3/users/2c6c86ea7f784e5d8378fa13438c8e2b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:52.805571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6c86ea7f784e5d8378fa13438c8e2b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:52.807515 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:52.858759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6c86ea7f784e5d8378fa13438c8e2b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:52.867253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6c86ea7f784e5d8378fa13438c8e2b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:52.875689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6c86ea7f784e5d8378fa13438c8e2b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:52.876391 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6c86ea7f784e5d8378fa13438c8e2b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:52.877065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6c86ea7f784e5d8378fa13438c8e2b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:52.898024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 988/2045] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:52 2022] DELETE /identity/v3/users/2c6c86ea7f784e5d8378fa13438c8e2b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:52.902644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:52.903174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:52.903391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:52.921466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:52.923332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:52.998382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1058/2046] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:53.008106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:53.009591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:53.074796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777182e-4f81-45c2-9fec-6527402b45d8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:53.079026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916d074-1f7a-4801-9ab4-7d82b0ab97a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:53.079703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916d074-1f7a-4801-9ab4-7d82b0ab97a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:53.079998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916d074-1f7a-4801-9ab4-7d82b0ab97a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:53.080296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916d074-1f7a-4801-9ab4-7d82b0ab97a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:53.089972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916d074-1f7a-4801-9ab4-7d82b0ab97a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:53.091534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916d074-1f7a-4801-9ab4-7d82b0ab97a3 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:53.103142 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 989/2047] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:53.487434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:53.489061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:53.501885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b11c6f-3b28-43bf-9f48-1e0de64967b7 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:53.506496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:53.507413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:53.507698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:53.507978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] PATH_INFO: `/v3/projects/8c41eabade644271ac01e833aa30a858` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:53.509169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c41eabade644271ac01e833aa30a858)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:53.511120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:53.560809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c41eabade644271ac01e833aa30a858', 'request_id': 'req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:53.568855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c41eabade644271ac01e833aa30a858', 'request_id': 'req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:53.574552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c41eabade644271ac01e833aa30a858', 'request_id': 'req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:53.587872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] The token cache is being invalidate because project 8c41eabade644271ac01e833aa30a858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:53.588267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:53.589393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3adcbbaf-12ff-4b8a-9dbe-9ebda9ac9c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:53.594968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1059/2048] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:53 2022] DELETE /identity/v3/projects/8c41eabade644271ac01e833aa30a858 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:53.597739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05227a54-76b5-4cc9-85c0-c9ad727d02a5 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:53.598000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05227a54-76b5-4cc9-85c0-c9ad727d02a5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:53.598490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05227a54-76b5-4cc9-85c0-c9ad727d02a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:53.691000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-05227a54-76b5-4cc9-85c0-c9ad727d02a5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:53.695388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-05227a54-76b5-4cc9-85c0-c9ad727d02a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:53.730527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:53.823102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 990/2049] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:53.825245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74439598-cd12-43ca-9785-3926fcf479a1 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:53.825425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74439598-cd12-43ca-9785-3926fcf479a1 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:53.825706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74439598-cd12-43ca-9785-3926fcf479a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:53.852890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-74439598-cd12-43ca-9785-3926fcf479a1 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:53.854214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-74439598-cd12-43ca-9785-3926fcf479a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:53.872644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1060/2050] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:53.873863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05227a54-76b5-4cc9-85c0-c9ad727d02a5 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:53.884200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05227a54-76b5-4cc9-85c0-c9ad727d02a5 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:53.889467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:53.889826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:53.890113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:53.890685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:53.891241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:53.891557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:53.893161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:53.906662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 991/2051] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:47:53.910839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74439598-cd12-43ca-9785-3926fcf479a1 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:53.923822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74439598-cd12-43ca-9785-3926fcf479a1 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:53.930359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:53.931342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:53.931782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:53.932431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:53.933337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:53.935906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:53.982146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1061/2052] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:53 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:53.986491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:53.998231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd526759-a2a0-42b5-adb9-1b8c1a0d52c0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:54.095123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:54.096382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.096857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.097172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.098050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:54.100924 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:54.126188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 992/2053] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:53 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:54.130004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:54.152567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe2792-358a-431e-9c7d-2cb72467600a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:54.158612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:54.159419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.159774 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.160063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.161058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:54.163221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:54.176652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1062/2054] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:54.180292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:54.190721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f2ada-1a62-4eb3-a893-a044d69378cb admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:54.195715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b4940-5655-49ec-8466-07770a825b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:54.197846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b4940-5655-49ec-8466-07770a825b40 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.197846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b4940-5655-49ec-8466-07770a825b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.197846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b4940-5655-49ec-8466-07770a825b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.197846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b4940-5655-49ec-8466-07770a825b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:54.199477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b4940-5655-49ec-8466-07770a825b40 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:54.210631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 993/2055] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:54.214702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:54.225172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f277d-d048-4c8d-9dc5-a5714a69d64f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:54.250641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:54.251599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.251992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.252165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] PATH_INFO: `/v3/projects/98d56a21c52b49ffbc838f590fe76d29/users/27e3a6db1a9b4c38bb8a5697ed08f8e7/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.272703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d56a21c52b49ffbc838f590fe76d29, user_id=27e3a6db1a9b4c38bb8a5697ed08f8e7, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:54.275424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:54.291007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1063/2056] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:54 2022] PUT /identity/v3/projects/98d56a21c52b49ffbc838f590fe76d29/users/27e3a6db1a9b4c38bb8a5697ed08f8e7/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:54.296438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.296899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.297143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.315658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:54.317393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:54.319332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:54.320973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:54.345004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:54.383472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 994/2057] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:54.389005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291196e-a8b5-4abd-b3ba-0f992e0404a1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:54.394268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:54.395112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:54.395939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.396222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.396478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] PATH_INFO: `/v3/users/2ada4576c0084912b41c846d849ce6ee` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.397319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:54.397764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ada4576c0084912b41c846d849ce6ee)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:54.399766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:54.434308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:54.470431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfad8b-5f0a-473f-8a01-39d8a7540b13 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:54.472586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ada4576c0084912b41c846d849ce6ee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:54.474229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:54.474896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.475840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.476129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.484926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ada4576c0084912b41c846d849ce6ee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:54.486576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ada4576c0084912b41c846d849ce6ee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:54.488753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:54.490549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:54.496757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ada4576c0084912b41c846d849ce6ee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:54.504046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 995/2058] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:54.510938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a1e307cd-7a28-4760-99eb-f4acf2f83745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ada4576c0084912b41c846d849ce6ee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:54.518010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1064/2059] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:54 2022] DELETE /identity/v3/users/2ada4576c0084912b41c846d849ce6ee => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:54.749475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:54.771784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873d0f-f347-4cbe-ba7e-9c26ba9500ae service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:54.841953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:54.843321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:54.843777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:54.844108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] PATH_INFO: `/v3/projects/21f1a2549de24c31910eb3cdb809c5e9` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:54.845392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f1a2549de24c31910eb3cdb809c5e9)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:54.847567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:54.954598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f1a2549de24c31910eb3cdb809c5e9', 'request_id': 'req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:54.967426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f1a2549de24c31910eb3cdb809c5e9', 'request_id': 'req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:54.977818 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f1a2549de24c31910eb3cdb809c5e9', 'request_id': 'req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:55.000490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] The token cache is being invalidate because project 21f1a2549de24c31910eb3cdb809c5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:55.000490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:55.000490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-fe8fdf89-ce94-4953-8bcb-e4b20fee5c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:55.000490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 996/2060] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:54 2022] DELETE /identity/v3/projects/21f1a2549de24c31910eb3cdb809c5e9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:55.001354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bebcb-8185-4a9c-bd09-4a0c4e86b49b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.001793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bebcb-8185-4a9c-bd09-4a0c4e86b49b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.001952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bebcb-8185-4a9c-bd09-4a0c4e86b49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.024825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-948bebcb-8185-4a9c-bd09-4a0c4e86b49b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:55.026202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-948bebcb-8185-4a9c-bd09-4a0c4e86b49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:55.090970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1065/2061] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:55.099635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef50a-2ef6-441d-8a8f-a9e53537e7bb None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.099958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef50a-2ef6-441d-8a8f-a9e53537e7bb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.100258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef50a-2ef6-441d-8a8f-a9e53537e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.118317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5faef50a-2ef6-441d-8a8f-a9e53537e7bb None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:55.119574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5faef50a-2ef6-441d-8a8f-a9e53537e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:55.128207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 997/2062] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:55.132359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bebcb-8185-4a9c-bd09-4a0c4e86b49b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.142363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bebcb-8185-4a9c-bd09-4a0c4e86b49b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.147301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777345c8-2534-4ea7-8bfa-2743f8f2a077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.148055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777345c8-2534-4ea7-8bfa-2743f8f2a077 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.148423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777345c8-2534-4ea7-8bfa-2743f8f2a077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.148772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777345c8-2534-4ea7-8bfa-2743f8f2a077 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.149652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777345c8-2534-4ea7-8bfa-2743f8f2a077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:55.151594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777345c8-2534-4ea7-8bfa-2743f8f2a077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.151738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777345c8-2534-4ea7-8bfa-2743f8f2a077 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.167891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1066/2063] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:47:55.169178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef50a-2ef6-441d-8a8f-a9e53537e7bb None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.179810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef50a-2ef6-441d-8a8f-a9e53537e7bb None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.188972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.189785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.190071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.190426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.191212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.193322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.232096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 998/2064] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:55 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:55.232294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.232294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.232294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.233067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.264112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] MFA Rules not processed for user `27e3a6db1a9b4c38bb8a5697ed08f8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:55.264384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:55.287979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:55.292025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:55.331866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f929b-8837-45a6-81e7-37e8faf5fad9 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.344916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.345761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.346168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.346572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.348296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.354388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.386645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1067/2065] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:55.397769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.402129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 999/2066] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:55 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:55.403468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:55.403608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.417220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969be3f-b35b-40fa-9e2b-66afb8a3f7f7 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.423601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.424403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.424971 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.425311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.426118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.428022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.439204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1000/2067] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:47:55.443144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.455047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbb262-ea5d-4f2e-b6e8-91103cede7ad admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.461085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.461968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.462099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.462321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.463282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.464678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.480387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1001/2068] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:47:55.485019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.493234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4af105-c9a6-42c6-bdb3-b5bd620d6108 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.497779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c2dcb-c32e-4a02-8f38-b58010b3c5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.498370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0623b-0ec5-4004-92cd-eec035bf849a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.498690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c2dcb-c32e-4a02-8f38-b58010b3c5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.499089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c2dcb-c32e-4a02-8f38-b58010b3c5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.499378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c2dcb-c32e-4a02-8f38-b58010b3c5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.504081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.505091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.505444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.505794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] PATH_INFO: `/v3/projects/7b4a919be31b4c74a3197d98ecec7fde/users/31fed190cac24d1b8326425f737e220b/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.511562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c2dcb-c32e-4a02-8f38-b58010b3c5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.513387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c2dcb-c32e-4a02-8f38-b58010b3c5a9 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.524941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4a919be31b4c74a3197d98ecec7fde, user_id=31fed190cac24d1b8326425f737e220b, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.527732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1068/2069] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:55.527890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.543936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1002/2070] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:55 2022] PUT /identity/v3/projects/7b4a919be31b4c74a3197d98ecec7fde/users/31fed190cac24d1b8326425f737e220b/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:55.550170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.550702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.551108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.570221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:55.571504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:55.641783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1069/2071] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:55.651296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:55.653109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:55.730656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abca13-7420-4bb1-9390-21da4141d7a9 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:55.734326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26e4cc-9a46-4cf5-bb24-b219356183ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:55.735045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26e4cc-9a46-4cf5-bb24-b219356183ec service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:55.735336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26e4cc-9a46-4cf5-bb24-b219356183ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:55.735618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26e4cc-9a46-4cf5-bb24-b219356183ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:55.747550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26e4cc-9a46-4cf5-bb24-b219356183ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:55.749019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26e4cc-9a46-4cf5-bb24-b219356183ec service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:55.758855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1003/2072] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:56.319872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:56.321644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:56.334866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a77b14-99a1-4c50-9ab7-3301339e0dec None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:56.339369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:56.344703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:56.345000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:56.345236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] PATH_INFO: `/v3/users/5fc8fa9db011420cb71ac25a208e4128` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:56.346868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc8fa9db011420cb71ac25a208e4128)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:56.348980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:56.408657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc8fa9db011420cb71ac25a208e4128'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:56.419782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc8fa9db011420cb71ac25a208e4128'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:56.420366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc8fa9db011420cb71ac25a208e4128'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:56.422719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:56.431535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc8fa9db011420cb71ac25a208e4128'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:56.450967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc8fa9db011420cb71ac25a208e4128'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:56.461071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1070/2073] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:56 2022] DELETE /identity/v3/users/5fc8fa9db011420cb71ac25a208e4128 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:56.465642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:56.465987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:56.466226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:56.483676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:56.485444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:56.552485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1004/2074] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:56.562353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:56.563800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:56.645856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a89af-68f6-4aa3-922d-5ef39c286fc8 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:56.650459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:56.651307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:56.651462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:56.651693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:56.674737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:56.677016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:56.693151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1071/2075] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:47:57.049854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:57.056352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:57.083730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec9192-5de1-4bf8-885b-4fd43c3c803b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:57.089242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:57.090137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:57.090427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:57.090710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] PATH_INFO: `/v3/projects/882608f030174ab8bbc28218615ce6eb` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:57.092163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=882608f030174ab8bbc28218615ce6eb)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:57.095239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:57.115643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:57.157631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882608f030174ab8bbc28218615ce6eb', 'request_id': 'req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.169264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882608f030174ab8bbc28218615ce6eb', 'request_id': 'req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.177978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882608f030174ab8bbc28218615ce6eb', 'request_id': 'req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.195223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] The token cache is being invalidate because project 882608f030174ab8bbc28218615ce6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:57.195604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.196264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.201615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1005/2076] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:57 2022] DELETE /identity/v3/projects/882608f030174ab8bbc28218615ce6eb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:57.203695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:57.215601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152ba1-a336-4806-b8fc-9d55de2fc5a1 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:57.305854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:57.306567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:57.306869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:57.307185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] PATH_INFO: `/v3/users/c494716c422b42998ab97acb73349601` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:57.308485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c494716c422b42998ab97acb73349601)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:57.310434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:57.365837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c494716c422b42998ab97acb73349601'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.376735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c494716c422b42998ab97acb73349601'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.377476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c494716c422b42998ab97acb73349601'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.387760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c494716c422b42998ab97acb73349601'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.401372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:57.408425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b0c3137a-e566-4666-9b63-81dfdbd921c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c494716c422b42998ab97acb73349601'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.444194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1072/2077] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:57 2022] DELETE /identity/v3/users/c494716c422b42998ab97acb73349601 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:57.767782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:57.769260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:57.787796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747fe77-ee0a-492c-9cfb-fcf64d0965cc admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:57.861069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:57.862115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:57.862476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:57.862940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] PATH_INFO: `/v3/projects/307cda824736421cb103fed7f9ec9e23` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:57.864209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307cda824736421cb103fed7f9ec9e23)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:57.866221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:57.913717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307cda824736421cb103fed7f9ec9e23', 'request_id': 'req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.924907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307cda824736421cb103fed7f9ec9e23', 'request_id': 'req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.944437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307cda824736421cb103fed7f9ec9e23', 'request_id': 'req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.960241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] The token cache is being invalidate because project 307cda824736421cb103fed7f9ec9e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:47:57.960610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.961360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2e7ecdf9-cddc-4ab7-b661-0cabd624d309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:57.963399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1006/2078] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:47:57 2022] DELETE /identity/v3/projects/307cda824736421cb103fed7f9ec9e23 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:57.971886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c743-b1cc-4d91-87f1-e67152cfefd8 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:57.976148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c743-b1cc-4d91-87f1-e67152cfefd8 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:57.976454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c743-b1cc-4d91-87f1-e67152cfefd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:57.998075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-0ba5c743-b1cc-4d91-87f1-e67152cfefd8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:57.999494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0ba5c743-b1cc-4d91-87f1-e67152cfefd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:58.027422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9919-ce57-42f0-83cf-efe4ac2cb2f3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.027990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9919-ce57-42f0-83cf-efe4ac2cb2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.028348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9919-ce57-42f0-83cf-efe4ac2cb2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.060717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-0eff9919-ce57-42f0-83cf-efe4ac2cb2f3 None None] MFA Rules not processed for user `27e3a6db1a9b4c38bb8a5697ed08f8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:58.064809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0eff9919-ce57-42f0-83cf-efe4ac2cb2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:58.141912 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1073/2079] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:58.142293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:58.147801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db5cc-8123-4ea5-85e6-2b3528d7f355 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.147801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db5cc-8123-4ea5-85e6-2b3528d7f355 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.148124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db5cc-8123-4ea5-85e6-2b3528d7f355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.183012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1007/2080] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:58.185178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ad6db5cc-8123-4ea5-85e6-2b3528d7f355 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:58.186430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ad6db5cc-8123-4ea5-85e6-2b3528d7f355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:58.212467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1074/2081] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:58.213954 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9919-ce57-42f0-83cf-efe4ac2cb2f3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:58.230289 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9919-ce57-42f0-83cf-efe4ac2cb2f3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:58.237282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:58.238165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.238611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.238951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.240069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:47:58.240392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:58.246539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:58.281431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1008/2082] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:47:58.282643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db5cc-8123-4ea5-85e6-2b3528d7f355 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:58.293180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db5cc-8123-4ea5-85e6-2b3528d7f355 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:58.298489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:58.299236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.299524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.299806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.300538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:58.302656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:58.345512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1075/2083] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:47:58 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:58.346646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:58.358799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96d6c1-0bb5-4b70-8cca-58a7f5e70244 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:58.458334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:58.459861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.460494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.460933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.463768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:58.466693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:58.503535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1009/2084] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:47:58 2022] POST /identity/v3/users => generated 280 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:47:58.507794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:58.520305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71785f26-9594-4d5d-81c3-bb57c26a01b9 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:58.526382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:58.527219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.527614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.527999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.528845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:58.530814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:58.544624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1076/2085] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:58.549884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:58.560459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c167c-62d8-4b3e-8b56-3650f266cfc5 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:58.565228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da3bc1-0337-46c8-b5dd-f04d2c873535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:58.565917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da3bc1-0337-46c8-b5dd-f04d2c873535 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.566213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da3bc1-0337-46c8-b5dd-f04d2c873535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.566502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da3bc1-0337-46c8-b5dd-f04d2c873535 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.570385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da3bc1-0337-46c8-b5dd-f04d2c873535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:58.570385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da3bc1-0337-46c8-b5dd-f04d2c873535 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:58.598149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1010/2086] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:47:58.602380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:58.615463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0fd23-c306-4910-98c4-10e540c7ee4b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:58.620418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:58.621354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.621696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.621986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] PATH_INFO: `/v3/projects/affa47b57ded4d86833316c209e0a548/users/e02056f1439e47fda6977ea404caac95/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.638334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affa47b57ded4d86833316c209e0a548, user_id=e02056f1439e47fda6977ea404caac95, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:58.641920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:58.657720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1077/2087] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:47:58 2022] PUT /identity/v3/projects/affa47b57ded4d86833316c209e0a548/users/e02056f1439e47fda6977ea404caac95/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:47:58.668767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd212e03-e4d9-4d94-9874-417594438d2e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.668999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd212e03-e4d9-4d94-9874-417594438d2e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.669609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd212e03-e4d9-4d94-9874-417594438d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.700689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-cd212e03-e4d9-4d94-9874-417594438d2e None None] MFA Rules not processed for user `e02056f1439e47fda6977ea404caac95`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:58.702096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-cd212e03-e4d9-4d94-9874-417594438d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:58.841807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1011/2088] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:58 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:47:58.877683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:58.879962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:58.966303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c04c99-40f7-4ef8-a0fe-c85c24a844a8 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:58.971959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d917fe-175a-4390-8f85-6e48579b509e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:58.972769 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d917fe-175a-4390-8f85-6e48579b509e service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:58.973066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d917fe-175a-4390-8f85-6e48579b509e service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:58.973359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d917fe-175a-4390-8f85-6e48579b509e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:58.986249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d917fe-175a-4390-8f85-6e48579b509e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:58.988142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d917fe-175a-4390-8f85-6e48579b509e service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:58.998764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1078/2089] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:58 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:47:59.014513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd212e03-e4d9-4d94-9874-417594438d2e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:59.070767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:59.107861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd212e03-e4d9-4d94-9874-417594438d2e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:59.113662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:59.114573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:59.114867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:59.115183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] PATH_INFO: `/v3/users/e02056f1439e47fda6977ea404caac95` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:59.116420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02056f1439e47fda6977ea404caac95)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:59.118570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:59.178700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02056f1439e47fda6977ea404caac95'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:59.188737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02056f1439e47fda6977ea404caac95'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:59.212550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02056f1439e47fda6977ea404caac95'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:59.213681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02056f1439e47fda6977ea404caac95'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:59.214613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02056f1439e47fda6977ea404caac95'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:47:59.241424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1012/2090] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:47:59 2022] DELETE /identity/v3/users/e02056f1439e47fda6977ea404caac95 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:47:59.242754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:59.243272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:59.243813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:59.282444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:47:59.283683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:59.332289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:47:59.419161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1079/2091] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:47:59.430350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:47:59.431868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:47:59.568852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc54cd-c30a-4c69-a72a-54fb9a4fa555 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:47:59.573808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e9c9e-7af0-4673-9f97-c69bb0e191c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:47:59.574419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9c9e-7af0-4673-9f97-c69bb0e191c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:47:59.574698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9c9e-7af0-4673-9f97-c69bb0e191c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:47:59.575061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9c9e-7af0-4673-9f97-c69bb0e191c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:47:59.597029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e9c9e-7af0-4673-9f97-c69bb0e191c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:47:59.600906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e9c9e-7af0-4673-9f97-c69bb0e191c4 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:47:59.631084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1013/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:00.213366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:00.215215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:00.235506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307df3c-05e6-4a60-b9ad-40c86e98e207 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:00.258522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:00.259480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.259771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.260061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] PATH_INFO: `/v3/projects/affa47b57ded4d86833316c209e0a548` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.266586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=affa47b57ded4d86833316c209e0a548)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:00.268492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:00.381126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affa47b57ded4d86833316c209e0a548', 'request_id': 'req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:00.390154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affa47b57ded4d86833316c209e0a548', 'request_id': 'req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:00.402712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affa47b57ded4d86833316c209e0a548', 'request_id': 'req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:00.415828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] The token cache is being invalidate because project affa47b57ded4d86833316c209e0a548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:48:00.416118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:00.416784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f13e2ebe-d35e-4bc4-a882-e1045ff07a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:00.418351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1080/2093] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:48:00 2022] DELETE /identity/v3/projects/affa47b57ded4d86833316c209e0a548 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:00.424652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314a00-11e5-46ac-87da-d3a3ab034409 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.425118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314a00-11e5-46ac-87da-d3a3ab034409 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.425475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314a00-11e5-46ac-87da-d3a3ab034409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.447640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ac314a00-11e5-46ac-87da-d3a3ab034409 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:00.448854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ac314a00-11e5-46ac-87da-d3a3ab034409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:00.512211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:00.534137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1014/2094] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:48:00.543394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fd912-89fa-42a3-b1d1-16b9ff6063bd None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.543685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fd912-89fa-42a3-b1d1-16b9ff6063bd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.544115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fd912-89fa-42a3-b1d1-16b9ff6063bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.565472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-099fd912-89fa-42a3-b1d1-16b9ff6063bd None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:00.566995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-099fd912-89fa-42a3-b1d1-16b9ff6063bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:00.578888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1081/2095] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:00.579953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314a00-11e5-46ac-87da-d3a3ab034409 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:00.594744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314a00-11e5-46ac-87da-d3a3ab034409 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:00.599647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:00.600337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.600945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.600945 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.602008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:48:00.602008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:00.603686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:00.621230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fd912-89fa-42a3-b1d1-16b9ff6063bd None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:00.631007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1015/2096] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:48:00.632296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fd912-89fa-42a3-b1d1-16b9ff6063bd None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:00.638480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f1bca-2939-42e4-a5bd-037f1132d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:00.661243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1bca-2939-42e4-a5bd-037f1132d71b admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.665407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1bca-2939-42e4-a5bd-037f1132d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.665705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1bca-2939-42e4-a5bd-037f1132d71b admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.668146 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f1bca-2939-42e4-a5bd-037f1132d71b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:00.670079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f1bca-2939-42e4-a5bd-037f1132d71b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:00.756606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1082/2097] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:48:00 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:48:00.760485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:00.781141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dffc57-dbd2-413a-9f53-48b787b91238 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:00.806480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb3b66-c491-4fe0-94be-752fed072f31 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.806480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb3b66-c491-4fe0-94be-752fed072f31 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.806480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb3b66-c491-4fe0-94be-752fed072f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.853618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-42cb3b66-c491-4fe0-94be-752fed072f31 None None] MFA Rules not processed for user `31fed190cac24d1b8326425f737e220b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:00.854997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-42cb3b66-c491-4fe0-94be-752fed072f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:00.939656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:00.940642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.940982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.941270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.941987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:00.944609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:00.975548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1083/2098] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:00.990956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:00.990956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:00.991246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1016/2099] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:48:00 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:48:00.991353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:00.999029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:01.014075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe4b6-ca85-4c47-8682-0e94fd89d99b admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:01.020694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:01.021540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:01.021856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:01.022226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:01.023234 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:01.025030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:01.032750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] MFA Rules not processed for user `31fed190cac24d1b8326425f737e220b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:01.034044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:01.045966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1017/2100] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:01.046158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1084/2101] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:01.048981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:01.060777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d00930-07d6-4879-8d3c-5a41423f122a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:01.064559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:01.067728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:01.068569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:01.069002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:01.069401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:01.070290 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:01.070479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:01.072176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:01.089139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1018/2102] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:01.092003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:01.101241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:01.107590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340a9ae-3297-4341-9644-ca49c561c44e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:01.113590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b8fc8-9dfe-4e4b-97c1-4ae77c3525f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:01.114549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b8fc8-9dfe-4e4b-97c1-4ae77c3525f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:01.114847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b8fc8-9dfe-4e4b-97c1-4ae77c3525f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:01.115193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b8fc8-9dfe-4e4b-97c1-4ae77c3525f9 admin admin] PATH_INFO: `/v3/projects/e3be499c98d54406ab9050b11694434b/users/ede00fad1f4b4af2ba04ce82e5982593/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:01.135587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b8fc8-9dfe-4e4b-97c1-4ae77c3525f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3be499c98d54406ab9050b11694434b, user_id=ede00fad1f4b4af2ba04ce82e5982593, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:01.139134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b8fc8-9dfe-4e4b-97c1-4ae77c3525f9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:01.163509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1019/2103] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:01 2022] PUT /identity/v3/projects/e3be499c98d54406ab9050b11694434b/users/ede00fad1f4b4af2ba04ce82e5982593/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:01.173784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:01.179839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:01.180160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:01.221232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] MFA Rules not processed for user `ede00fad1f4b4af2ba04ce82e5982593`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:01.222535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:01.226486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe1ca6-1dd9-4ca1-b8e5-21caf4e1906c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:01.307635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1020/2104] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:01.310500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eef3e-d80f-4d27-88fa-17d8531f564f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:01.312664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eef3e-d80f-4d27-88fa-17d8531f564f service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:01.312957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eef3e-d80f-4d27-88fa-17d8531f564f service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:01.313243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eef3e-d80f-4d27-88fa-17d8531f564f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:01.323177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:01.324503 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:01.363235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:01.410553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eef3e-d80f-4d27-88fa-17d8531f564f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:01.412835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eef3e-d80f-4d27-88fa-17d8531f564f service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:01.432730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1085/2105] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:01.439716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba22b36-50c0-4679-b311-8f54a60af635 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:01.444854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:01.445776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:01.446065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:01.446474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:01.461283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:01.463354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:01.478306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1021/2106] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:48:02.452103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:02.453112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:02.453332 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:02.475471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] MFA Rules not processed for user `31fed190cac24d1b8326425f737e220b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:02.477024 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:02.486757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1086/2107] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:48:04.258577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:04.404690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117cf44-8ba6-4ce6-b378-8403e51b5ac5 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:04.412472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:04.413907 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:04.414421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:04.415374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] PATH_INFO: `/v3/users/ede00fad1f4b4af2ba04ce82e5982593` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:04.416885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede00fad1f4b4af2ba04ce82e5982593)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:04.419450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:04.475812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:04.478026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:04.500967 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f27e9-4f00-4e4b-8cd8-4d91c836f71f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:04.506957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:04.508225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:04.508721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:04.509369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] PATH_INFO: `/v3/users/2d2e57fdb86c4c428152e68fb2bfa88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:04.510998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2e57fdb86c4c428152e68fb2bfa88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:04.513191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:04.525372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede00fad1f4b4af2ba04ce82e5982593'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.544388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede00fad1f4b4af2ba04ce82e5982593'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.571393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:04.575782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede00fad1f4b4af2ba04ce82e5982593'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.576988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede00fad1f4b4af2ba04ce82e5982593'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.579522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-32bb6b75-d717-4279-a594-e577381d5b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede00fad1f4b4af2ba04ce82e5982593'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.587762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2e57fdb86c4c428152e68fb2bfa88e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.607938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2e57fdb86c4c428152e68fb2bfa88e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.608763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2e57fdb86c4c428152e68fb2bfa88e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.617021 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2e57fdb86c4c428152e68fb2bfa88e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.631814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1022/2108] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:48:04 2022] DELETE /identity/v3/users/ede00fad1f4b4af2ba04ce82e5982593 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:04.633816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:04.635357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:04.637512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:04.659952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a6a5778b-c4d7-4f15-b0ee-e645f0fd2cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2e57fdb86c4c428152e68fb2bfa88e'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:04.663773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:04.665178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:04.670294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1087/2109] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:48:04 2022] DELETE /identity/v3/users/2d2e57fdb86c4c428152e68fb2bfa88e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:04.675399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:04.677079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:04.677658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:04.700006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:04.701326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:04.725151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:04.764927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1023/2110] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:48:04.776970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:04.778412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:04.802189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1088/2111] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:04.814754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:04.816371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:04.885478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b96421-b218-4985-86c6-5c384e8ae155 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:04.920377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d05d9e-83bd-49a3-8ec0-c029253b0064 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:04.924968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:04.925638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:04.926300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:04.926437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:04.950528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:04.952188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:04.962412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:04.963165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:04.963458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:04.963739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:04.979118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1089/2112] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:48:04.981604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:04.983309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:04.995153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1024/2113] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:48:05.500634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:05.502267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:05.514771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:05.517066 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:05.532780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1f1c2-bb4a-44b6-8228-bc539cc96905 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:05.537701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46042be6-0a35-4b12-bbbf-a208c8549312 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:05.540305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:05.543262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:05.544283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:05.544731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:05.545050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] PATH_INFO: `/v3/projects/3804e89a75f04b1a8acbe48b582c58d6` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:05.547007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:05.547563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:05.547863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] PATH_INFO: `/v3/projects/e3be499c98d54406ab9050b11694434b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:05.549633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3be499c98d54406ab9050b11694434b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:05.551989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:05.555369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3804e89a75f04b1a8acbe48b582c58d6)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:05.558441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:05.628252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3804e89a75f04b1a8acbe48b582c58d6', 'request_id': 'req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.630076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:05.632831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3be499c98d54406ab9050b11694434b', 'request_id': 'req-9e3a9234-8745-4814-adcc-81f02e72597a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.639125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3804e89a75f04b1a8acbe48b582c58d6', 'request_id': 'req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.643600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3be499c98d54406ab9050b11694434b', 'request_id': 'req-9e3a9234-8745-4814-adcc-81f02e72597a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.647643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3804e89a75f04b1a8acbe48b582c58d6', 'request_id': 'req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.651186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3be499c98d54406ab9050b11694434b', 'request_id': 'req-9e3a9234-8745-4814-adcc-81f02e72597a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.662542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] The token cache is being invalidate because project 3804e89a75f04b1a8acbe48b582c58d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:48:05.662947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.663729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-edad13af-15c1-4fb7-aa5d-e958a07c2e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.668739 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1090/2114] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:48:05 2022] DELETE /identity/v3/projects/3804e89a75f04b1a8acbe48b582c58d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:05.670074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8b21-3f90-4db6-95f1-aa88f2f31bfb None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:05.670373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8b21-3f90-4db6-95f1-aa88f2f31bfb None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:05.670822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8b21-3f90-4db6-95f1-aa88f2f31bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:05.678203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] The token cache is being invalidate because project e3be499c98d54406ab9050b11694434b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:48:05.678502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.680479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e3a9234-8745-4814-adcc-81f02e72597a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:05.682405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1025/2115] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:48:05 2022] DELETE /identity/v3/projects/e3be499c98d54406ab9050b11694434b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:48:05.707199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6abe8b21-3f90-4db6-95f1-aa88f2f31bfb None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:05.708754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6abe8b21-3f90-4db6-95f1-aa88f2f31bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:05.819795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1091/2116] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:05.824209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22bde-2861-4f64-bc3c-31679589081e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:05.824558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22bde-2861-4f64-bc3c-31679589081e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:05.824968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22bde-2861-4f64-bc3c-31679589081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:05.847582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b9a22bde-2861-4f64-bc3c-31679589081e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:05.848822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b9a22bde-2861-4f64-bc3c-31679589081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:05.858961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1026/2117] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:05.863166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe8b21-3f90-4db6-95f1-aa88f2f31bfb None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:05.877054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe8b21-3f90-4db6-95f1-aa88f2f31bfb None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:05.881941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:05.882691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:05.883088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:05.883495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:05.884323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:48:05.884707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:05.886396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:05.902654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1092/2118] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:48:05.903763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a22bde-2861-4f64-bc3c-31679589081e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:05.913180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a22bde-2861-4f64-bc3c-31679589081e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:05.917770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:05.918416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:05.918704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:05.919017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:05.919719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:05.921617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:05.931238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:05.947985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1027/2119] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:48:05 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:48:05.953197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:05.963140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346abc9-b301-4776-953e-d93b4a515ed1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:06.019226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:06.019913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.020210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.020530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.021317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:06.023360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:06.044063 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1093/2120] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:48:05 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:48:06.048023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:06.058342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fcf7c-dd4e-45d2-835f-02eb88a07969 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:06.062953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:06.063619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.063910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.064194 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.064928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:06.066556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:06.078510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1028/2121] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:06.082446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:06.092512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592bb62-a821-4a51-9807-27d99b50cfc6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:06.097308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27669c16-2afb-45bd-9c53-fac21d8b8373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:06.098007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27669c16-2afb-45bd-9c53-fac21d8b8373 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.098302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27669c16-2afb-45bd-9c53-fac21d8b8373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.098606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27669c16-2afb-45bd-9c53-fac21d8b8373 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.099369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27669c16-2afb-45bd-9c53-fac21d8b8373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:06.100992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27669c16-2afb-45bd-9c53-fac21d8b8373 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:06.111797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1094/2122] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:06.116373 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:06.126908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cd3b-4b1f-4f99-8c9a-942fb75ff92f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:06.131742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:06.132628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.132921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.133202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] PATH_INFO: `/v3/projects/631332018aa64203aedb4f89819c2e9f/users/a0e3af6f849b466a8162f6d8e4e1162d/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.148698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631332018aa64203aedb4f89819c2e9f, user_id=a0e3af6f849b466a8162f6d8e4e1162d, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:06.151449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:06.164903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1029/2123] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:06 2022] PUT /identity/v3/projects/631332018aa64203aedb4f89819c2e9f/users/a0e3af6f849b466a8162f6d8e4e1162d/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:48:06.176013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b415a9-b245-4294-bd9e-180f16ec6cfd None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.176308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b415a9-b245-4294-bd9e-180f16ec6cfd None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.176617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b415a9-b245-4294-bd9e-180f16ec6cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.207231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-28b415a9-b245-4294-bd9e-180f16ec6cfd None None] MFA Rules not processed for user `a0e3af6f849b466a8162f6d8e4e1162d`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:06.208452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-28b415a9-b245-4294-bd9e-180f16ec6cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:06.240807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:06.274964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1095/2124] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:06.286048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:06.288048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:06.343918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb27ee-ac44-46c5-a5d8-7e99fe2bea97 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:06.347509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9cc5c-6a82-4e75-91dd-9113ed0dbb95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:06.348160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9cc5c-6a82-4e75-91dd-9113ed0dbb95 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.348454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9cc5c-6a82-4e75-91dd-9113ed0dbb95 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.348742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9cc5c-6a82-4e75-91dd-9113ed0dbb95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.356927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9cc5c-6a82-4e75-91dd-9113ed0dbb95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:06.358471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9cc5c-6a82-4e75-91dd-9113ed0dbb95 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:06.367731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1030/2125] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:06.392423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b415a9-b245-4294-bd9e-180f16ec6cfd None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:06.455210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b415a9-b245-4294-bd9e-180f16ec6cfd None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:06.459959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:06.460846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.461137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.461420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] PATH_INFO: `/v3/users/a0e3af6f849b466a8162f6d8e4e1162d` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.462623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e3af6f849b466a8162f6d8e4e1162d)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:06.464643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:06.510264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e3af6f849b466a8162f6d8e4e1162d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:06.517478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e3af6f849b466a8162f6d8e4e1162d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:06.518220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e3af6f849b466a8162f6d8e4e1162d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:06.525099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e3af6f849b466a8162f6d8e4e1162d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:06.537437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e3af6f849b466a8162f6d8e4e1162d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:06.544218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1096/2126] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:48:06 2022] DELETE /identity/v3/users/a0e3af6f849b466a8162f6d8e4e1162d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:06.548906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.549343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.549498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.566702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:06.567946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:06.625548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1031/2127] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:06.635007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:06.636449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:06.693947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead6878-e63e-441d-88e2-02a41e539121 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:06.697694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de528b-d188-4a1d-b246-d151d84662dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:06.698349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de528b-d188-4a1d-b246-d151d84662dc service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:06.698640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de528b-d188-4a1d-b246-d151d84662dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:06.698968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de528b-d188-4a1d-b246-d151d84662dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:06.706876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:06.709557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de528b-d188-4a1d-b246-d151d84662dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:06.715058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de528b-d188-4a1d-b246-d151d84662dc service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:06.723324 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1097/2128] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:06.986366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:06.987883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:07.006124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295cfe-7bea-4e47-bed2-f378205fe091 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.012707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.013640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.013890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.014165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] PATH_INFO: `/v3/projects/631332018aa64203aedb4f89819c2e9f` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.015570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631332018aa64203aedb4f89819c2e9f)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.017671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.065520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631332018aa64203aedb4f89819c2e9f', 'request_id': 'req-f599be37-5ac4-456e-ae74-36fd11d631a5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:07.069108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:07.072812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631332018aa64203aedb4f89819c2e9f', 'request_id': 'req-f599be37-5ac4-456e-ae74-36fd11d631a5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:07.079989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631332018aa64203aedb4f89819c2e9f', 'request_id': 'req-f599be37-5ac4-456e-ae74-36fd11d631a5'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:07.091195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] The token cache is being invalidate because project 631332018aa64203aedb4f89819c2e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:48:07.091480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:07.092118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f599be37-5ac4-456e-ae74-36fd11d631a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:07.094317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1032/2129] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:48:06 2022] DELETE /identity/v3/projects/631332018aa64203aedb4f89819c2e9f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:07.099585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314c47c-603d-4bcb-8b36-949ecff3afbf None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.099886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314c47c-603d-4bcb-8b36-949ecff3afbf None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.100198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314c47c-603d-4bcb-8b36-949ecff3afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.117355 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3314c47c-603d-4bcb-8b36-949ecff3afbf None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:07.118559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3314c47c-603d-4bcb-8b36-949ecff3afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:07.177712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1098/2130] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:07.186391 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930eb3d7-dce6-430c-bbaa-cdfa428d48d1 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.186685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930eb3d7-dce6-430c-bbaa-cdfa428d48d1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.187034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930eb3d7-dce6-430c-bbaa-cdfa428d48d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.205533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-930eb3d7-dce6-430c-bbaa-cdfa428d48d1 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:07.206719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-930eb3d7-dce6-430c-bbaa-cdfa428d48d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:07.215035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1033/2131] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:07.219850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314c47c-603d-4bcb-8b36-949ecff3afbf None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:07.231039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314c47c-603d-4bcb-8b36-949ecff3afbf None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.237435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.238164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.238454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.238751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.239589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:48:07.239912 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.241566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.253892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1099/2132] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:48:07.258232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930eb3d7-dce6-430c-bbaa-cdfa428d48d1 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:07.268083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930eb3d7-dce6-430c-bbaa-cdfa428d48d1 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.272826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.273545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.273859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.274136 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.274844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.276886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.305001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1034/2133] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:48:07 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:48:07.309090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:07.319219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df7ca-305b-466f-b610-34c9e9c00989 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.375994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.376664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.376950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.377230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.377959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.379915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.399404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1100/2134] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:48:07 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:48:07.403455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:07.413920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902ae1-45cc-421d-977a-efeebc342c5c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.418572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.419277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.419566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.419848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.420580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.422174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.432493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1035/2135] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:07.436361 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:07.446896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64220d-f186-4134-a5c9-786614143c2c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.451586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85ab13-9629-491e-97f8-f2d345d7b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.452280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85ab13-9629-491e-97f8-f2d345d7b573 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.453286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85ab13-9629-491e-97f8-f2d345d7b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.453580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85ab13-9629-491e-97f8-f2d345d7b573 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.454323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85ab13-9629-491e-97f8-f2d345d7b573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.456028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85ab13-9629-491e-97f8-f2d345d7b573 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.469222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1101/2136] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:07.470357 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:07.480601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb68dfd-03cc-4ba6-b47b-7a445b77f5d5 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.485210 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.486092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.486374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.486650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] PATH_INFO: `/v3/projects/afb8f33898e2408eaaac28b7f1802314/users/a5d3b9702e434e038466969abfae2338/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.501861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb8f33898e2408eaaac28b7f1802314, user_id=a5d3b9702e434e038466969abfae2338, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.504653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.518092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1036/2137] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:07 2022] PUT /identity/v3/projects/afb8f33898e2408eaaac28b7f1802314/users/a5d3b9702e434e038466969abfae2338/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:07.523264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e43f1-50df-4f93-be1e-6aafa874669f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.523729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e43f1-50df-4f93-be1e-6aafa874669f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.523847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e43f1-50df-4f93-be1e-6aafa874669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.542189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-811e43f1-50df-4f93-be1e-6aafa874669f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:07.543616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-811e43f1-50df-4f93-be1e-6aafa874669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:07.601041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1102/2138] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:07.610957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:07.612679 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:07.667545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e033-238e-444e-bad0-d236ed597dbb admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:07.671710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:07.672353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:07.672648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:07.672933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:07.682044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:07.683570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:07.693518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1037/2139] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:14.397792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d651b-b810-44f3-a260-20d759936df4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:14.398365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d651b-b810-44f3-a260-20d759936df4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:14.398467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d651b-b810-44f3-a260-20d759936df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:14.404744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:14.442187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e50d651b-b810-44f3-a260-20d759936df4 None None] MFA Rules not processed for user `a5d3b9702e434e038466969abfae2338`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:14.443529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e50d651b-b810-44f3-a260-20d759936df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:14.518906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1103/2140] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:14.519668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:14.530140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00078f3-ebe7-45d3-abbd-b6a4c857f003 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:14.535281 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:14.535958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:14.536249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:14.536534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:14.537662 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:14.540114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:14.570960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1038/2141] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:48:14 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:48:14.574730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d651b-b810-44f3-a260-20d759936df4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:14.586429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d651b-b810-44f3-a260-20d759936df4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:14.642387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:14.643104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:14.643399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:14.643681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:14.644371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:14.646299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:14.665200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1104/2142] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:48:14 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:48:14.669297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:14.679765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913230c-bc6d-4739-8f9d-dcaef870c19d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:14.684379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:14.685049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:14.685343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:14.685629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:14.686365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:14.688556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:14.699376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1039/2143] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:48:14.704183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:14.714624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410a678-aaf5-46d9-9681-9ee78516b18a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:14.720261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:14.721242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:14.721541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:14.722224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] PATH_INFO: `/v3/projects/474744b60a6244e7aa86a2fa2014ac15/users/3c163067ec8a4e0aa86a9bfa3e784738/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:14.739839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=474744b60a6244e7aa86a2fa2014ac15, user_id=3c163067ec8a4e0aa86a9bfa3e784738, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:14.742954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:14.757218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1105/2144] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:14 2022] PUT /identity/v3/projects/474744b60a6244e7aa86a2fa2014ac15/users/3c163067ec8a4e0aa86a9bfa3e784738/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:14.761366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:14.771899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a29b3-43f6-494a-9e54-f117d5f7e7fc admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:14.817330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:14.832339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:14.833029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:14.833320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:14.833623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:14.834364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:14.836134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:14.846103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1040/2145] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:48:14.851166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:14.861481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b8dd-dfbb-444d-b1b2-93a500a9ebcb admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:14.866162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eebf5-4b12-47b7-b5c3-59440c9ce0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:14.867091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eebf5-4b12-47b7-b5c3-59440c9ce0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:14.867384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eebf5-4b12-47b7-b5c3-59440c9ce0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:14.867666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eebf5-4b12-47b7-b5c3-59440c9ce0d7 admin admin] PATH_INFO: `/v3/projects/474744b60a6244e7aa86a2fa2014ac15/users/3c163067ec8a4e0aa86a9bfa3e784738/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:14.869637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eebf5-4b12-47b7-b5c3-59440c9ce0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474744b60a6244e7aa86a2fa2014ac15, user_id=3c163067ec8a4e0aa86a9bfa3e784738, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:14.872320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eebf5-4b12-47b7-b5c3-59440c9ce0d7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:14.882963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1106/2146] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:14 2022] PUT /identity/v3/projects/474744b60a6244e7aa86a2fa2014ac15/users/3c163067ec8a4e0aa86a9bfa3e784738/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:20.639596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:20.642269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:20.657700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630a7e7-6654-4f15-b203-3ae5cb73ce8e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:20.788081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:20.789239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:20.789759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:20.790325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] PATH_INFO: `/v3/users/69e9236fdb39431ca379809fca5cd53f` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:20.793588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e9236fdb39431ca379809fca5cd53f)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:20.796164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:20.879372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e9236fdb39431ca379809fca5cd53f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:20.898001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e9236fdb39431ca379809fca5cd53f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:20.919126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e9236fdb39431ca379809fca5cd53f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:20.919965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e9236fdb39431ca379809fca5cd53f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:20.923186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6371149e-0284-4efa-be3c-38d254709a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e9236fdb39431ca379809fca5cd53f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:20.945819 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1041/2147] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:48:20 2022] DELETE /identity/v3/users/69e9236fdb39431ca379809fca5cd53f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:20.950215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:20.950680 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:20.950771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:20.969838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:20.971554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:20.989227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:20.989620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:20.990000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:21.021655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] MFA Rules not processed for user `3c163067ec8a4e0aa86a9bfa3e784738`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:21.023139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:21.040272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:21.068280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1107/2148] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:21.078495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:21.080321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:21.098348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:21.135360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1042/2149] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:21.149178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:21.150582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:21.157685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a565420-7518-4524-bb08-f0a2616bba16 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:21.161385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:21.162147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:21.162740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:21.163118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:21.176040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:21.177601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:21.189245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1108/2150] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:21.254467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34110e76-081a-4207-b6b8-4de31b4dd804 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:21.260955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98bc9b-e738-4d40-9f65-e57f3b952fb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:21.261656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98bc9b-e738-4d40-9f65-e57f3b952fb1 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:21.261942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98bc9b-e738-4d40-9f65-e57f3b952fb1 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:21.262280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98bc9b-e738-4d40-9f65-e57f3b952fb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:21.264175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-af98bc9b-e738-4d40-9f65-e57f3b952fb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:21.369559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98bc9b-e738-4d40-9f65-e57f3b952fb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:21.371284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98bc9b-e738-4d40-9f65-e57f3b952fb1 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:21.382189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1043/2151] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:48:21.683567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:21.687250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:21.711909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3ab8e-3144-4886-b909-2e23c958dc38 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:21.717114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:21.719073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:21.719073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:21.719294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] PATH_INFO: `/v3/projects/01e9e6e0f0c84889adbb91c5af1c0b33` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:21.720439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e9e6e0f0c84889adbb91c5af1c0b33)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:21.723100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:21.812858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e9e6e0f0c84889adbb91c5af1c0b33', 'request_id': 'req-7056628c-f41d-404c-8ab9-35ace12cb163'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:21.838548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e9e6e0f0c84889adbb91c5af1c0b33', 'request_id': 'req-7056628c-f41d-404c-8ab9-35ace12cb163'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:21.853891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e9e6e0f0c84889adbb91c5af1c0b33', 'request_id': 'req-7056628c-f41d-404c-8ab9-35ace12cb163'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:21.869414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] The token cache is being invalidate because project 01e9e6e0f0c84889adbb91c5af1c0b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:48:21.869674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:21.870477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-7056628c-f41d-404c-8ab9-35ace12cb163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:21.872281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1109/2152] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:48:21 2022] DELETE /identity/v3/projects/01e9e6e0f0c84889adbb91c5af1c0b33 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:21.877999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7124e-29cf-4ea2-9cba-dfdee82f3b3e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:21.879188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7124e-29cf-4ea2-9cba-dfdee82f3b3e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:21.879480 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7124e-29cf-4ea2-9cba-dfdee82f3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:21.900332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d0e7124e-29cf-4ea2-9cba-dfdee82f3b3e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:21.901716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d0e7124e-29cf-4ea2-9cba-dfdee82f3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:21.981535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1044/2153] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:48:21.990089 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73d5c-c2ff-4bae-a1ac-94fe2fb41b85 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:21.990636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73d5c-c2ff-4bae-a1ac-94fe2fb41b85 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:21.990811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73d5c-c2ff-4bae-a1ac-94fe2fb41b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.011305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d0a73d5c-c2ff-4bae-a1ac-94fe2fb41b85 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:22.017561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d0a73d5c-c2ff-4bae-a1ac-94fe2fb41b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:22.036083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1110/2154] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:22.041612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7124e-29cf-4ea2-9cba-dfdee82f3b3e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:22.056192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7124e-29cf-4ea2-9cba-dfdee82f3b3e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:22.064647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:22.065354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.065649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.065935 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.066690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:48:22.067035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:22.069610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:22.095093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1045/2155] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:48:22.096731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73d5c-c2ff-4bae-a1ac-94fe2fb41b85 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:22.106989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73d5c-c2ff-4bae-a1ac-94fe2fb41b85 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:22.112441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:22.113155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.113410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.114079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.115252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:22.117134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:22.150044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1111/2156] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:48:22 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:48:22.154519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:22.169739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad86d8-3b19-424a-84ee-ab447ce1c52a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:22.198014 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:22.290442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:22.291038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.291478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.291990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.292806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:22.294961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:22.319909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1046/2157] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:48:22 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:48:22.323744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:22.336526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e28dde-655e-4c76-a655-bed72d068573 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:22.345369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:22.346062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.346526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.346806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.347600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:22.349214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:22.363009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1112/2158] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:22.365452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:22.379037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6aae8-38f7-4f7f-b3c7-9fa30e30936b admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:22.386627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322256f-8588-42b3-8c4d-63697b2934c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:22.387369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322256f-8588-42b3-8c4d-63697b2934c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.387664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322256f-8588-42b3-8c4d-63697b2934c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.387953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322256f-8588-42b3-8c4d-63697b2934c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.388709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322256f-8588-42b3-8c4d-63697b2934c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:22.391101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322256f-8588-42b3-8c4d-63697b2934c0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:22.402013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1047/2159] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:48:22.406376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:22.421105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648cec-24ee-41c5-8c42-1eb6ef548f63 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:22.435088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:22.436023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.436945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.437230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] PATH_INFO: `/v3/projects/1622ca6e4f384a3d991c206be16fe11d/users/e44eafc900ed474ea4f755afef97a922/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.456011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1622ca6e4f384a3d991c206be16fe11d, user_id=e44eafc900ed474ea4f755afef97a922, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:22.459226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:22.475172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1113/2160] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:22 2022] PUT /identity/v3/projects/1622ca6e4f384a3d991c206be16fe11d/users/e44eafc900ed474ea4f755afef97a922/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:22.488148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca31ea-e15f-46df-aa5b-c0a421cbb0e0 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.488574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca31ea-e15f-46df-aa5b-c0a421cbb0e0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.488941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca31ea-e15f-46df-aa5b-c0a421cbb0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.520835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bfca31ea-e15f-46df-aa5b-c0a421cbb0e0 None None] MFA Rules not processed for user `e44eafc900ed474ea4f755afef97a922`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:22.522342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bfca31ea-e15f-46df-aa5b-c0a421cbb0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:22.608880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1048/2161] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:22.621049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:22.623050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:22.636427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:22.720780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80568-3ad4-4f13-9141-f873bb01cc20 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:22.727822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:22.728495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.728785 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.729070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.743115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:22.744748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:22.758939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1114/2162] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:22.821517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d35fd-b272-4dad-b82b-5206f849c228 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:22.821517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d35fd-b272-4dad-b82b-5206f849c228 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:22.821517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d35fd-b272-4dad-b82b-5206f849c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:22.865039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-163d35fd-b272-4dad-b82b-5206f849c228 None None] MFA Rules not processed for user `a5d3b9702e434e038466969abfae2338`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:22.866572 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-163d35fd-b272-4dad-b82b-5206f849c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:22.935390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1049/2163] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:32.748619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:32.830873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359356-3c8a-43f3-bb7e-ce373df8e03c service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:32.835697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:32.836685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:32.836973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:32.837255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] PATH_INFO: `/v3/users/e44eafc900ed474ea4f755afef97a922` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:32.838485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44eafc900ed474ea4f755afef97a922)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:32.840474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:32.896173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44eafc900ed474ea4f755afef97a922'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:32.903591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44eafc900ed474ea4f755afef97a922'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:32.904275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44eafc900ed474ea4f755afef97a922'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:32.911853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44eafc900ed474ea4f755afef97a922'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:32.925963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44eafc900ed474ea4f755afef97a922'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:32.928120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:32.934308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1115/2164] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:48:32 2022] DELETE /identity/v3/users/e44eafc900ed474ea4f755afef97a922 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:32.938858 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:32.939184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:32.939471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:32.957356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:32.958626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:33.018135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1050/2165] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:33.027562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.029002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:33.062703 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:33.090901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dffc3-748e-4847-b9e4-aa7ad677bfb4 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.094544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a254f5-da2c-4fa4-a88f-76dfa57478f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.095230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a254f5-da2c-4fa4-a88f-76dfa57478f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.095522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a254f5-da2c-4fa4-a88f-76dfa57478f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.095808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a254f5-da2c-4fa4-a88f-76dfa57478f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.104844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a254f5-da2c-4fa4-a88f-76dfa57478f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.106389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a254f5-da2c-4fa4-a88f-76dfa57478f1 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.116829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1116/2166] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:33.394640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.396148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:33.408828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67f6a4-c9aa-4230-b7ce-2ac416659b53 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.413834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.414717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.415039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.415324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] PATH_INFO: `/v3/projects/1622ca6e4f384a3d991c206be16fe11d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.416528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1622ca6e4f384a3d991c206be16fe11d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.418447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.466977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1622ca6e4f384a3d991c206be16fe11d', 'request_id': 'req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:33.475026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1622ca6e4f384a3d991c206be16fe11d', 'request_id': 'req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:33.480708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1622ca6e4f384a3d991c206be16fe11d', 'request_id': 'req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:33.492566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] The token cache is being invalidate because project 1622ca6e4f384a3d991c206be16fe11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:48:33.492887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:33.493546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ea22ea9a-3f38-400a-a50f-d6f2a37c362a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:48:33.495111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1051/2167] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:48:33 2022] DELETE /identity/v3/projects/1622ca6e4f384a3d991c206be16fe11d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:33.499932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b952e7-ab44-4f3b-be56-ba360cc109fc None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.500230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b952e7-ab44-4f3b-be56-ba360cc109fc None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.500514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b952e7-ab44-4f3b-be56-ba360cc109fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.518701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f1b952e7-ab44-4f3b-be56-ba360cc109fc None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:33.519903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f1b952e7-ab44-4f3b-be56-ba360cc109fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:33.581642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1117/2168] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:33.590081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad191-b1bc-44af-a7a3-3b0707ddb548 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.590379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad191-b1bc-44af-a7a3-3b0707ddb548 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.590665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad191-b1bc-44af-a7a3-3b0707ddb548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.609516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-203ad191-b1bc-44af-a7a3-3b0707ddb548 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:33.610717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-203ad191-b1bc-44af-a7a3-3b0707ddb548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:33.618710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1052/2169] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:33.622530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b952e7-ab44-4f3b-be56-ba360cc109fc None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.632645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b952e7-ab44-4f3b-be56-ba360cc109fc None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.637352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.638018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.638310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.638592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.639429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:48:33.639742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.641336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.653073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1118/2170] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:48:33.658004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad191-b1bc-44af-a7a3-3b0707ddb548 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.667981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad191-b1bc-44af-a7a3-3b0707ddb548 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.675828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.676327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.676617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.676902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.677726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.679982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.711566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1053/2171] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:48:33.717056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.728056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75502c-0d4e-4188-bfbb-286c23b214dc admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.809827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.810582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.810955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.811934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.812689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.814653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.833687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1119/2172] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:48:33 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:48:33.837532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.847791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb626-6761-4ac1-a337-f21324f362c6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.852333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.853002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.853291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.853574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.854306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.855980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.867248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1054/2173] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:33.871275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.882124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7570b-312e-4d37-aee5-d4a28d43562c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.888046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4f259-bf98-4afa-9180-7b50e716d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.888719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4f259-bf98-4afa-9180-7b50e716d47e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.889013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4f259-bf98-4afa-9180-7b50e716d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.889849 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4f259-bf98-4afa-9180-7b50e716d47e admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.890602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4f259-bf98-4afa-9180-7b50e716d47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.892247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4f259-bf98-4afa-9180-7b50e716d47e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.902268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1120/2174] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:33.907052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:33.917764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ed97-c6c3-4bbb-9be0-662d9527d6b1 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:33.922426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:33.923416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.923768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.924113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] PATH_INFO: `/v3/projects/4b52def37b964824993a0edb3abc3413/users/b98488d018b04b34a6758f8b55925316/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.938190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b52def37b964824993a0edb3abc3413, user_id=b98488d018b04b34a6758f8b55925316, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:33.940891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:33.953832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1055/2175] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:33 2022] PUT /identity/v3/projects/4b52def37b964824993a0edb3abc3413/users/b98488d018b04b34a6758f8b55925316/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:33.958955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ca14-214c-4c1b-8247-1c5df5bee1e4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:33.959275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ca14-214c-4c1b-8247-1c5df5bee1e4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:33.959551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ca14-214c-4c1b-8247-1c5df5bee1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:33.979057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1ca6ca14-214c-4c1b-8247-1c5df5bee1e4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:33.980507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1ca6ca14-214c-4c1b-8247-1c5df5bee1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:34.022217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:34.051112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1121/2176] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:34.060465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:34.062821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:34.084102 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:34.119363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa136-495d-47a7-9688-7f771ff74645 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:34.123016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:34.124283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:34.124591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:34.124874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:34.133778 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:34.135274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:34.144608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1056/2177] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:38.011411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6fd9-6851-42b6-ba91-97d15613fc62 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:38.011901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6fd9-6851-42b6-ba91-97d15613fc62 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:38.012092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6fd9-6851-42b6-ba91-97d15613fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:38.039535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fa7d6fd9-6851-42b6-ba91-97d15613fc62 None None] MFA Rules not processed for user `b98488d018b04b34a6758f8b55925316`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:38.040815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fa7d6fd9-6851-42b6-ba91-97d15613fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:38.118689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1122/2178] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:38.123193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:38.134817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aea062-1e46-4e7a-993b-16b1f727b398 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:38.140082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:38.140745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:38.141037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:38.141319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:38.142138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:38.144089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:38.170498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1057/2179] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:48:38 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:48:38.175695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6fd9-6851-42b6-ba91-97d15613fc62 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:38.187054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6fd9-6851-42b6-ba91-97d15613fc62 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:38.260543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:38.261358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:38.261736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:38.262085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:38.263187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:38.265817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:38.289954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1123/2180] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:48:38 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:48:38.292087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:38.304553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edae98-2a68-4514-8d31-7bf2c757cfbd admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:38.309277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:38.310098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:38.310471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:38.310820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:38.311734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:38.313468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:38.330958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1058/2181] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:48:38.333103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:38.344580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3601-b973-43f6-8bed-68b0f39937b7 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:38.349297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:38.350201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:38.350493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:38.350778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] PATH_INFO: `/v3/projects/dc8a637cd7ab41e2848fae0f5c879254/users/f75574d0bfda428da53c1db716ab4ced/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:38.366666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8a637cd7ab41e2848fae0f5c879254, user_id=f75574d0bfda428da53c1db716ab4ced, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:38.369401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:38.382585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1124/2182] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:38 2022] PUT /identity/v3/projects/dc8a637cd7ab41e2848fae0f5c879254/users/f75574d0bfda428da53c1db716ab4ced/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:38.386464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:38.412919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a51ae-658e-48a7-b98f-02658ef34578 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:38.491186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a9190-ecce-4910-8cd9-dbbf93bdb0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:38.491877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9190-ecce-4910-8cd9-dbbf93bdb0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:38.492173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9190-ecce-4910-8cd9-dbbf93bdb0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:38.492459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9190-ecce-4910-8cd9-dbbf93bdb0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:38.493446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a9190-ecce-4910-8cd9-dbbf93bdb0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:38.495473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a9190-ecce-4910-8cd9-dbbf93bdb0b7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:38.509758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1059/2183] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:48:38.513817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:38.524677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eae50-88ee-4169-8a0d-cf698ccd10a9 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:38.529540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:38.530505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:38.530780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:38.531107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] PATH_INFO: `/v3/projects/dc8a637cd7ab41e2848fae0f5c879254/users/f75574d0bfda428da53c1db716ab4ced/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:38.533148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8a637cd7ab41e2848fae0f5c879254, user_id=f75574d0bfda428da53c1db716ab4ced, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:38.535860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:38.549350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1125/2184] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:48:38 2022] PUT /identity/v3/projects/dc8a637cd7ab41e2848fae0f5c879254/users/f75574d0bfda428da53c1db716ab4ced/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:48:43.341720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fcd94-4caf-479e-bcba-c31b284f90cb None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:43.342321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fcd94-4caf-479e-bcba-c31b284f90cb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:43.342807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fcd94-4caf-479e-bcba-c31b284f90cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:43.390834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-349fcd94-4caf-479e-bcba-c31b284f90cb None None] MFA Rules not processed for user `f75574d0bfda428da53c1db716ab4ced`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:43.392148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-349fcd94-4caf-479e-bcba-c31b284f90cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:43.464992 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:43.510506 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1060/2185] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:43.518315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:43.520203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:43.551140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:43.612200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33b01-184b-427b-9e1f-8748065b0700 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:43.617462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880c7a0632ef44a1ab446d1bb53399fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:43.617462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:43.617753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:43.617992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:43.715575 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:43.717361 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:43.729048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1126/2186] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:48:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:48:43.899232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb97813-91c5-49ce-9d41-f3268573156c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:43.899556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb97813-91c5-49ce-9d41-f3268573156c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:43.899849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb97813-91c5-49ce-9d41-f3268573156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:43.921765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-beb97813-91c5-49ce-9d41-f3268573156c None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:43.923233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-beb97813-91c5-49ce-9d41-f3268573156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:44.002626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1061/2187] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:48:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:44.051313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:44.052780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:44.138889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f477-2474-46cb-b3bd-7e7c825b5a23 service glance] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:44.143868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469ce3e-c871-4fe4-949b-37e2c6d06085 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:44.144525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ce3e-c871-4fe4-949b-37e2c6d06085 service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:44.144815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ce3e-c871-4fe4-949b-37e2c6d06085 service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:44.145101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469ce3e-c871-4fe4-949b-37e2c6d06085 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:44.153029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469ce3e-c871-4fe4-949b-37e2c6d06085 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:44.155171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469ce3e-c871-4fe4-949b-37e2c6d06085 service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:44.163430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1127/2188] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:48:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:48:53.377900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd05fa-63a2-4387-9881-d24510755b12 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:53.378431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd05fa-63a2-4387-9881-d24510755b12 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:53.378521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd05fa-63a2-4387-9881-d24510755b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:53.396077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3cdd05fa-63a2-4387-9881-d24510755b12 None None] MFA Rules not processed for user `b98488d018b04b34a6758f8b55925316`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:53.397312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3cdd05fa-63a2-4387-9881-d24510755b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:53.404262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1062/2189] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:54.159917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=80 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:48:55.331022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:55.331802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:55.331802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:55.359381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:48:55.360868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:48:55.368141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1128/2190] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:48:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:48:55.380838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd05fa-63a2-4387-9881-d24510755b12 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:48:55.393259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd05fa-63a2-4387-9881-d24510755b12 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:48:55.398358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab9fdd-b687-49e9-819a-349fbdd77e91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:48:55.399149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab9fdd-b687-49e9-819a-349fbdd77e91 service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:48:55.399443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab9fdd-b687-49e9-819a-349fbdd77e91 service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:48:55.399727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab9fdd-b687-49e9-819a-349fbdd77e91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:48:55.408174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab9fdd-b687-49e9-819a-349fbdd77e91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:48:55.410041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab9fdd-b687-49e9-819a-349fbdd77e91 service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:48:55.418658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1063/2191] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:48:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:49:05.354458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=7 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:05.415273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=44 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:12.221771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:49:12.223283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:49:12.333611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b8015-35fb-4628-aa8a-382f5e40a630 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:49:12.338611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:49:12.339373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:49:12.339693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:49:12.339974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:49:12.341845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:49:12.353261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:49:12.355766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:49:12.366615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1129/2192] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:49:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:49:22.362117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=41 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:43.621191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3673-3c69-468a-998d-21820df6d1c9 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:49:43.621872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3673-3c69-468a-998d-21820df6d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:49:43.622793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3673-3c69-468a-998d-21820df6d1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:49:43.662013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b5ad3673-3c69-468a-998d-21820df6d1c9 None None] MFA Rules not processed for user `c3134832f2a647aab761da347f7e9fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:49:43.664381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b5ad3673-3c69-468a-998d-21820df6d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:49:43.754327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1064/2193] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:49:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:49:49.554285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:49:49.555868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:49:49.636307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd165b-b68a-413c-b9dc-050a7f791c8c service placement] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:49:49.640186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c012de-b01b-4314-be4c-7bc155cebfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:49:49.640855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c012de-b01b-4314-be4c-7bc155cebfbb service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:49:49.641173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c012de-b01b-4314-be4c-7bc155cebfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:49:49.641458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c012de-b01b-4314-be4c-7bc155cebfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:49:49.643309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-89c012de-b01b-4314-be4c-7bc155cebfbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:49:49.705676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c012de-b01b-4314-be4c-7bc155cebfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:49:49.707151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c012de-b01b-4314-be4c-7bc155cebfbb service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:49:49.716823 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1130/2194] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:49:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:49:53.741704 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=25 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:49:59.712387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=59 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:16.417820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7e4cc-467d-41ef-8759-60b98683eb64 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:16.418404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7e4cc-467d-41ef-8759-60b98683eb64 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:16.418404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7e4cc-467d-41ef-8759-60b98683eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:16.440354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d6f7e4cc-467d-41ef-8759-60b98683eb64 None None] MFA Rules not processed for user `27e3a6db1a9b4c38bb8a5697ed08f8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:50:16.441621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d6f7e4cc-467d-41ef-8759-60b98683eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:50:16.498422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1065/2195] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:50:16.803366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0e99-f0a5-45b6-b61f-d25c3ad87500 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:16.803956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0e99-f0a5-45b6-b61f-d25c3ad87500 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:16.803956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0e99-f0a5-45b6-b61f-d25c3ad87500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:16.861128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-7eee0e99-f0a5-45b6-b61f-d25c3ad87500 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:50:16.862378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7eee0e99-f0a5-45b6-b61f-d25c3ad87500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:50:16.888956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1131/2196] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:50:16.937701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7e4cc-467d-41ef-8759-60b98683eb64 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:50:16.963879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7e4cc-467d-41ef-8759-60b98683eb64 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:50:16.969876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804092eb-ea15-42d0-a1cb-3e57a667a92f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:50:16.970633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804092eb-ea15-42d0-a1cb-3e57a667a92f service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:16.970982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804092eb-ea15-42d0-a1cb-3e57a667a92f service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:16.971340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804092eb-ea15-42d0-a1cb-3e57a667a92f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:16.981119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804092eb-ea15-42d0-a1cb-3e57a667a92f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:50:16.983429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804092eb-ea15-42d0-a1cb-3e57a667a92f service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:50:16.993719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1066/2197] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:50:18.075393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0e99-f0a5-45b6-b61f-d25c3ad87500 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:50:18.087439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0e99-f0a5-45b6-b61f-d25c3ad87500 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:50:18.097026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fc583-2d6f-40fc-a901-11fb0d460567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:50:18.097827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fc583-2d6f-40fc-a901-11fb0d460567 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:18.099070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fc583-2d6f-40fc-a901-11fb0d460567 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:18.099385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fc583-2d6f-40fc-a901-11fb0d460567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:18.128777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fc583-2d6f-40fc-a901-11fb0d460567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:50:18.131111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fc583-2d6f-40fc-a901-11fb0d460567 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:50:18.146549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1132/2198] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:50:20.304190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca99a88-1378-4d98-ae25-dae4ba1ac5c7 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:20.308015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca99a88-1378-4d98-ae25-dae4ba1ac5c7 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:20.308708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca99a88-1378-4d98-ae25-dae4ba1ac5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:20.345414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5ca99a88-1378-4d98-ae25-dae4ba1ac5c7 None None] MFA Rules not processed for user `31fed190cac24d1b8326425f737e220b`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:50:20.347068 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5ca99a88-1378-4d98-ae25-dae4ba1ac5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:50:20.427770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1067/2199] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:50:28.141718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=27 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:30.421672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=60 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:42.160624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26d9dd-d672-40e0-9616-678022cc62df None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.161234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26d9dd-d672-40e0-9616-678022cc62df None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.161234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26d9dd-d672-40e0-9616-678022cc62df None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.162586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1133/2200] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:50:42.169567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953e33-e2f4-47eb-b55f-12c38b334a4e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.170468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953e33-e2f4-47eb-b55f-12c38b334a4e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.170952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953e33-e2f4-47eb-b55f-12c38b334a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.257624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-5d953e33-e2f4-47eb-b55f-12c38b334a4e None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:50:42.258891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5d953e33-e2f4-47eb-b55f-12c38b334a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:50:42.350014 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1068/2201] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:50:42.361804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26d9dd-d672-40e0-9616-678022cc62df None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:50:42.383387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26d9dd-d672-40e0-9616-678022cc62df None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:50:42.387118 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bf7e9-3d3c-43f8-aef4-418b836240dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880c7a0632ef44a1ab446d1bb53399fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:50:42.387842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bf7e9-3d3c-43f8-aef4-418b836240dd service glance] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.388158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bf7e9-3d3c-43f8-aef4-418b836240dd service glance] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.388549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bf7e9-3d3c-43f8-aef4-418b836240dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.400012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bf7e9-3d3c-43f8-aef4-418b836240dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:50:42.401982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bf7e9-3d3c-43f8-aef4-418b836240dd service glance] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:50:42.413338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1134/2202] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:50:42.485114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919badb-b7f3-47be-a4d7-cefe957bab3b None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.485429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919badb-b7f3-47be-a4d7-cefe957bab3b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.485715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919badb-b7f3-47be-a4d7-cefe957bab3b None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.487243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1069/2203] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:50:42.492201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c441-8fa5-4547-b26c-a5ca687e204a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.492591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c441-8fa5-4547-b26c-a5ca687e204a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.492941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c441-8fa5-4547-b26c-a5ca687e204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.510716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-39a6c441-8fa5-4547-b26c-a5ca687e204a None None] MFA Rules not processed for user `b3d7fbf23c584c32a518abd0b5326229`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:50:42.511976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-39a6c441-8fa5-4547-b26c-a5ca687e204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:50:42.518418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1135/2204] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:50:42.530898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919badb-b7f3-47be-a4d7-cefe957bab3b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:50:42.543247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919badb-b7f3-47be-a4d7-cefe957bab3b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:50:42.546813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4f7a3-2508-475c-a3d8-c047dd653896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:50:42.547493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4f7a3-2508-475c-a3d8-c047dd653896 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.547785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4f7a3-2508-475c-a3d8-c047dd653896 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.548067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4f7a3-2508-475c-a3d8-c047dd653896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.556214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4f7a3-2508-475c-a3d8-c047dd653896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:50:42.557724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4f7a3-2508-475c-a3d8-c047dd653896 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:50:42.565979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1070/2205] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:50:42.646973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246c07e-26c5-4adc-a8f0-557f1dafce0c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.647271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246c07e-26c5-4adc-a8f0-557f1dafce0c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.647557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246c07e-26c5-4adc-a8f0-557f1dafce0c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.649004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1136/2206] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:50:42.655052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4d66-968b-430d-a77c-6d37f17540a3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.655350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4d66-968b-430d-a77c-6d37f17540a3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.655635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4d66-968b-430d-a77c-6d37f17540a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.675157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d8fc4d66-968b-430d-a77c-6d37f17540a3 None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:50:42.676379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d8fc4d66-968b-430d-a77c-6d37f17540a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:50:42.686143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1071/2207] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:50:42.696821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246c07e-26c5-4adc-a8f0-557f1dafce0c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:50:42.708624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246c07e-26c5-4adc-a8f0-557f1dafce0c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:50:42.716730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:50:42.717483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:42.717934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:42.718393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:42.731835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:50:42.733457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:50:42.744820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1137/2208] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:50:52.669927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=59 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:52.739763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=19 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:50:55.741795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f00b9-9475-400b-877f-022146108a7c None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:55.742252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f00b9-9475-400b-877f-022146108a7c None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:55.742372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f00b9-9475-400b-877f-022146108a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:55.761286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-f50f00b9-9475-400b-877f-022146108a7c None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:50:55.762400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f50f00b9-9475-400b-877f-022146108a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:50:55.769589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1072/2209] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:50:55.782036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:50:55.795012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e807d-b516-472d-86d2-21523c757f02 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:50:55.801322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:50:55.801938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:50:55.802258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:50:55.802553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:50:55.812050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:50:55.813883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:50:55.822616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1138/2210] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:50:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:51:03.351544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f00b9-9475-400b-877f-022146108a7c None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:03.361816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f00b9-9475-400b-877f-022146108a7c None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:03.365507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:03.366167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:03.366454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:03.366736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:03.368544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:03.382969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:03.384427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:03.395910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1073/2211] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:51:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:51:05.819316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=6 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:06.929577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:06.938682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299d95e-d1ab-4272-9bba-331b63612232 service swift] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:06.942224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:06.942864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:06.943184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:06.943469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:06.945228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:06.958816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:06.960270 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:06.971814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1139/2212] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:51:11.635044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:11.636492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:11.650405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6ae3-8a50-4d01-a60d-3d7096ad6fb0 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:11.656707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1ee1f-36f3-441b-828c-9b2c2e2d44e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:11.657366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ee1f-36f3-441b-828c-9b2c2e2d44e1 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:11.657658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ee1f-36f3-441b-828c-9b2c2e2d44e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:11.657939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1ee1f-36f3-441b-828c-9b2c2e2d44e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:11.659711 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3cd1ee1f-36f3-441b-828c-9b2c2e2d44e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:11.726490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1ee1f-36f3-441b-828c-9b2c2e2d44e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:11.728387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1ee1f-36f3-441b-828c-9b2c2e2d44e1 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:11.739400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1074/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:51:16.966877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=6 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:21.734787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=37 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:30.676600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:30.686156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea6e6e-72f8-4463-bf48-dc6008d5f29f service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:30.689831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:30.690487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:30.690779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:30.691101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:30.692943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:30.703316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:30.704662 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:30.713288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1140/2214] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:51:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:51:33.864277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:33.865126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:33.865418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:33.883470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:51:33.884926 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:33.892725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1075/2215] 10.222.0.43 () {58 vars in 967 bytes} [Mon Jun 20 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:51:33.915264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:33.927106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f07065-ba1c-4ebf-b08e-6b1a272899d8 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:33.932028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:33.932687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:33.932978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:33.933262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:33.941176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:33.942764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:33.951340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1141/2216] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:51:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:51:43.878073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:43.948084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=12 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:50.978330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:50.980378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:50.995695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8914-7cae-4c3e-80a9-50a007599986 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.000774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.001441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.001753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.002019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.003850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:51.016056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.017643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.029090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1076/2217] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:51:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:51:51.043399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.045017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:51.142741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd77aa5-1196-48d5-9bb5-4a48581555d1 service swift] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.147264 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.148149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.148437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.148718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] PATH_INFO: `/v3/users/27e3a6db1a9b4c38bb8a5697ed08f8e7` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.149918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e3a6db1a9b4c38bb8a5697ed08f8e7)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.152534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.198122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e3a6db1a9b4c38bb8a5697ed08f8e7'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.205400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e3a6db1a9b4c38bb8a5697ed08f8e7'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.206066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e3a6db1a9b4c38bb8a5697ed08f8e7'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.214453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e3a6db1a9b4c38bb8a5697ed08f8e7'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.226142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-db59e39c-f6ad-4dbe-ab13-bf11a0584295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e3a6db1a9b4c38bb8a5697ed08f8e7'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.232103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1142/2218] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:51:51 2022] DELETE /identity/v3/users/27e3a6db1a9b4c38bb8a5697ed08f8e7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:51:51.402529 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.413595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e92aee-e464-46e4-9468-5c3a3392f352 service placement] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.476352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.477227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.477512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.477793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] PATH_INFO: `/v3/projects/98d56a21c52b49ffbc838f590fe76d29` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.479031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d56a21c52b49ffbc838f590fe76d29)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.480929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.526342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d56a21c52b49ffbc838f590fe76d29', 'request_id': 'req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.532548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d56a21c52b49ffbc838f590fe76d29', 'request_id': 'req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.538067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d56a21c52b49ffbc838f590fe76d29', 'request_id': 'req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.549514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] The token cache is being invalidate because project 98d56a21c52b49ffbc838f590fe76d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:51:51.549803 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.550436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-08a2b312-d2f2-44c2-9e29-8ff1acd4c91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:51:51.551996 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1077/2219] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:51:51 2022] DELETE /identity/v3/projects/98d56a21c52b49ffbc838f590fe76d29 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:51:51.557522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ff8e-b23d-479f-bd5e-44005fbe8e71 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.557820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ff8e-b23d-479f-bd5e-44005fbe8e71 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.558106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716ff8e-b23d-479f-bd5e-44005fbe8e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.603949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6716ff8e-b23d-479f-bd5e-44005fbe8e71 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:51:51.605168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6716ff8e-b23d-479f-bd5e-44005fbe8e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:51.629246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:51.665262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1143/2220] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:51:51.672990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5b80-918e-4c63-8b7c-f8df4f5bfeb1 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.673286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5b80-918e-4c63-8b7c-f8df4f5bfeb1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.673573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5b80-918e-4c63-8b7c-f8df4f5bfeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.691406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-9a0a5b80-918e-4c63-8b7c-f8df4f5bfeb1 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:51:51.692601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9a0a5b80-918e-4c63-8b7c-f8df4f5bfeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:51.701120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1078/2221] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:51:51.705222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716ff8e-b23d-479f-bd5e-44005fbe8e71 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.715209 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716ff8e-b23d-479f-bd5e-44005fbe8e71 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.719832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.720498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.720820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.721107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.721845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:51:51.722159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.723792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.735859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1144/2222] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:51:51.739967 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5b80-918e-4c63-8b7c-f8df4f5bfeb1 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.749688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5b80-918e-4c63-8b7c-f8df4f5bfeb1 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.754299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.754977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.755271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.755558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.756269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.758171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.784676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1079/2223] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:51:51 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:51:51.788766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.799302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788007-eeba-4e7c-bd20-06dcc3b47254 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.854889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.855589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.855886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.856176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.856935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.858891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.880732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1145/2224] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:51:51 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:51:51.883306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.893761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6349-8f9a-46cc-8757-7ad6ad786cdd admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.898355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.899044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.899331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.899612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.900336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.901926 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.911640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1080/2225] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:51:51.915544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.925622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c294bd-f2bc-4820-a4b8-b2048b44f95b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.930106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece2236-8067-4e9a-b48d-fcf69706409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.930755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece2236-8067-4e9a-b48d-fcf69706409c admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.931085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece2236-8067-4e9a-b48d-fcf69706409c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.931369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece2236-8067-4e9a-b48d-fcf69706409c admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.932697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece2236-8067-4e9a-b48d-fcf69706409c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.934288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece2236-8067-4e9a-b48d-fcf69706409c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.945020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1146/2226] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:51:51.948790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:51.958449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5783e5-3b02-4cb9-a259-bc945e93c383 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:51.963075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:51.963961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:51.964248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:51.964528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] PATH_INFO: `/v3/projects/15cdb02d83a54499a23e3cee669b1b74/users/50dbb21c15da43b5912a9e75c2872544/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:51.979188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cdb02d83a54499a23e3cee669b1b74, user_id=50dbb21c15da43b5912a9e75c2872544, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:51.981825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:51.995342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1081/2227] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:51:51 2022] PUT /identity/v3/projects/15cdb02d83a54499a23e3cee669b1b74/users/50dbb21c15da43b5912a9e75c2872544/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:51:52.005084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc045c9-fe75-4672-97cf-dfcce7f7eb6e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:52.005379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc045c9-fe75-4672-97cf-dfcce7f7eb6e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:52.005690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc045c9-fe75-4672-97cf-dfcce7f7eb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:52.031516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-edc045c9-fe75-4672-97cf-dfcce7f7eb6e None None] MFA Rules not processed for user `50dbb21c15da43b5912a9e75c2872544`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:51:52.032741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-edc045c9-fe75-4672-97cf-dfcce7f7eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:52.096075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1147/2228] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:51:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:51:52.107899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:51:52.109643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:51:52.127065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:51:52.187642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954d8a7-cee3-46d9-998c-83eaec5894f2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:51:52.191255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cdd55-5c66-4c0d-8c32-e2309797ab2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:51:52.191903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cdd55-5c66-4c0d-8c32-e2309797ab2c service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:51:52.192196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cdd55-5c66-4c0d-8c32-e2309797ab2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:51:52.192482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cdd55-5c66-4c0d-8c32-e2309797ab2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:51:52.201213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cdd55-5c66-4c0d-8c32-e2309797ab2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:51:52.202665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cdd55-5c66-4c0d-8c32-e2309797ab2c service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:51:52.211325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1082/2229] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:51:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:52:01.384504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc045c9-fe75-4672-97cf-dfcce7f7eb6e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:01.412124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:01.450447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc045c9-fe75-4672-97cf-dfcce7f7eb6e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:01.454870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:01.455787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:01.456079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:01.456362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] PATH_INFO: `/v3/users/50dbb21c15da43b5912a9e75c2872544` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:01.457556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50dbb21c15da43b5912a9e75c2872544)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:01.459530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:01.506841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50dbb21c15da43b5912a9e75c2872544'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:01.514637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50dbb21c15da43b5912a9e75c2872544'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:01.515288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50dbb21c15da43b5912a9e75c2872544'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:01.522218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50dbb21c15da43b5912a9e75c2872544'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:01.534418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50dbb21c15da43b5912a9e75c2872544'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:01.540559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1148/2230] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:52:01 2022] DELETE /identity/v3/users/50dbb21c15da43b5912a9e75c2872544 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:52:01.545120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:01.545590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:01.545683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:01.562741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:52:01.564175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:01.621122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1083/2231] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:52:01.630749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:01.632192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:01.688418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b2db1-0b34-4cc1-8be5-505774ed5d7a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:01.692196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:01.692878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:01.693171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:01.693466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:01.703484 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:01.704966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:01.714591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1149/2232] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:52:01.976970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:01.979043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:01.992805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234d1d-bef0-4553-a921-933f5ab8c67d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:01.998522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:01.999591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:01.999921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:02.000328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] PATH_INFO: `/v3/projects/15cdb02d83a54499a23e3cee669b1b74` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:02.001785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cdb02d83a54499a23e3cee669b1b74)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:02.003729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:02.050840 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cdb02d83a54499a23e3cee669b1b74', 'request_id': 'req-e9b98c29-8c92-4612-b146-aab1a2e123f4'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:02.058692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cdb02d83a54499a23e3cee669b1b74', 'request_id': 'req-e9b98c29-8c92-4612-b146-aab1a2e123f4'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:02.064403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cdb02d83a54499a23e3cee669b1b74', 'request_id': 'req-e9b98c29-8c92-4612-b146-aab1a2e123f4'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:02.075866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] The token cache is being invalidate because project 15cdb02d83a54499a23e3cee669b1b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:52:02.076154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:02.076785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:52:02.078329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1084/2233] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:52:01 2022] DELETE /identity/v3/projects/15cdb02d83a54499a23e3cee669b1b74 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:52:11.710211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=68,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:12.072268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:21.075712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:21.077198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:21.149218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af88ed0-397a-4cd6-8d69-a7891befdf51 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:21.210862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:21.211543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:21.211837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:21.212719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:21.214503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:21.270597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:21.272254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:21.281771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1150/2234] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:52:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:52:31.277678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=84 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:36.702201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:36.703631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:36.719808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b98c29-8c92-4612-b146-aab1a2e123f4 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:36.725221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb29f2-2e3e-44c5-b287-d1021623e1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:36.725890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb29f2-2e3e-44c5-b287-d1021623e1c2 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:36.726257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb29f2-2e3e-44c5-b287-d1021623e1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:36.726601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb29f2-2e3e-44c5-b287-d1021623e1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:36.729155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5adb29f2-2e3e-44c5-b287-d1021623e1c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:36.794959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb29f2-2e3e-44c5-b287-d1021623e1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:36.796638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb29f2-2e3e-44c5-b287-d1021623e1c2 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:36.805824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1085/2235] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:52:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:52:40.193664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:40.196067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:40.217318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dc78a-3b1e-45ae-8d5f-7d7074accb5d service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:40.224734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:40.225401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:40.225698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:40.225983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:40.228640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:40.241529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:40.243305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:40.254705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1151/2236] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:52:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:52:46.801637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=28 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:52:49.061317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:49.061879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:49.061879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:49.078514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] MFA Rules not processed for user `c3134832f2a647aab761da347f7e9fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:52:49.080208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:49.088994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1086/2237] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:52:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:52:49.381235 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:49.382644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:49.440819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cda654-5eef-4e95-aa7d-318bf55c4b7a service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:49.444406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:49.445148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:49.445440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:49.445751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:49.447597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:49.457020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:49.458488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:49.467343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1152/2238] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:52:51.792660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:52:51.794110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:51.867170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df55a16-0087-415e-b5b9-4064b0161d13 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:52:51.872379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814033ea-93a0-49d2-be68-e623f04e5f17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:52:51.873220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814033ea-93a0-49d2-be68-e623f04e5f17 service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:52:51.873505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814033ea-93a0-49d2-be68-e623f04e5f17 service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:52:51.873785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814033ea-93a0-49d2-be68-e623f04e5f17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:52:51.875601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-814033ea-93a0-49d2-be68-e623f04e5f17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:52:51.888092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814033ea-93a0-49d2-be68-e623f04e5f17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:52:51.889670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814033ea-93a0-49d2-be68-e623f04e5f17 service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:52:51.900305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1087/2239] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:52:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:52:59.464062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=32 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:01.503798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:01.519369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68aff9-1429-48fd-917f-8275793c2da2 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:01.525594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:01.526393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:01.526687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:01.527009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:01.528850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:01.593380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:01.595466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:01.608980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1153/2240] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:01.895304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=35 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:02.776908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e6b48-bfc5-4046-a6f4-03a3026e4667 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:02.777301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e6b48-bfc5-4046-a6f4-03a3026e4667 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:02.778071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e6b48-bfc5-4046-a6f4-03a3026e4667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:02.805677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-394e6b48-bfc5-4046-a6f4-03a3026e4667 None None] MFA Rules not processed for user `60a36e18710443359ba2a56ad2810043`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:53:02.806989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-394e6b48-bfc5-4046-a6f4-03a3026e4667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:02.883481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1088/2241] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:53:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:53:04.917504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:04.931821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9f64e-4485-4960-8ce4-dc228aec60ac service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:04.943374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecb8d3-ab36-42c5-b4bb-fa9d09cad9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:04.944148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb8d3-ab36-42c5-b4bb-fa9d09cad9e9 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:04.944504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb8d3-ab36-42c5-b4bb-fa9d09cad9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:04.944852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb8d3-ab36-42c5-b4bb-fa9d09cad9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:04.947391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-dfecb8d3-ab36-42c5-b4bb-fa9d09cad9e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:04.963183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecb8d3-ab36-42c5-b4bb-fa9d09cad9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:04.965900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecb8d3-ab36-42c5-b4bb-fa9d09cad9e9 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:04.979973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1154/2242] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:09.794966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e6b48-bfc5-4046-a6f4-03a3026e4667 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:09.807612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e6b48-bfc5-4046-a6f4-03a3026e4667 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:09.813766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:09.814932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:09.814932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:09.815228 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:09.817029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:09.830287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:09.831890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:09.842443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1089/2243] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:14.974383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=34 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:17.067445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb9c4-fdae-499b-bfab-8ec7e3cb86a1 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:17.068050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb9c4-fdae-499b-bfab-8ec7e3cb86a1 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:17.068050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb9c4-fdae-499b-bfab-8ec7e3cb86a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:17.086174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-2b9bb9c4-fdae-499b-bfab-8ec7e3cb86a1 None None] MFA Rules not processed for user `31fed190cac24d1b8326425f737e220b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:53:17.087342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2b9bb9c4-fdae-499b-bfab-8ec7e3cb86a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:17.094255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1155/2244] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:53:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:53:19.837929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=31 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:21.475392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:21.486561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c28f9-c202-4fc2-a17c-1909263fdf0e service nova] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:21.492604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da47bc-9d57-44d2-acae-30791e7859c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:21.493348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da47bc-9d57-44d2-acae-30791e7859c4 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:21.493640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da47bc-9d57-44d2-acae-30791e7859c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:21.493923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da47bc-9d57-44d2-acae-30791e7859c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:21.495706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-18da47bc-9d57-44d2-acae-30791e7859c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:21.552003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da47bc-9d57-44d2-acae-30791e7859c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:21.553555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da47bc-9d57-44d2-acae-30791e7859c4 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:21.562857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1090/2245] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:21.853534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bb3b4-47c2-405b-bee5-e593349f308c None None] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:21.854104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bb3b4-47c2-405b-bee5-e593349f308c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:21.854104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bb3b4-47c2-405b-bee5-e593349f308c None None] PATH_INFO: `/` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:21.855510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1156/2246] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:53:21.861197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b1885-2549-47e5-ba7e-005f138d983a None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:21.861562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b1885-2549-47e5-ba7e-005f138d983a None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:21.861928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b1885-2549-47e5-ba7e-005f138d983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:21.880585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-dc3b1885-2549-47e5-ba7e-005f138d983a None None] MFA Rules not processed for user `b3d7fbf23c584c32a518abd0b5326229`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:53:21.881806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dc3b1885-2549-47e5-ba7e-005f138d983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:21.888540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1091/2247] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:53:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:53:21.901075 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bb3b4-47c2-405b-bee5-e593349f308c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:21.902743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-185bb3b4-47c2-405b-bee5-e593349f308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:21.916480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bb3b4-47c2-405b-bee5-e593349f308c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:21.919934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d4b10-4b7b-4820-9531-08cb5b531b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:21.920576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d4b10-4b7b-4820-9531-08cb5b531b22 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:21.920869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d4b10-4b7b-4820-9531-08cb5b531b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:21.921150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d4b10-4b7b-4820-9531-08cb5b531b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:21.928535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d4b10-4b7b-4820-9531-08cb5b531b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:21.930040 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d4b10-4b7b-4820-9531-08cb5b531b22 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:21.937838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1157/2248] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:22.020903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8c5b-1b59-46ca-8a1e-2ad7be95e2a5 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:22.021204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8c5b-1b59-46ca-8a1e-2ad7be95e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:22.021491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8c5b-1b59-46ca-8a1e-2ad7be95e2a5 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:22.023060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1092/2249] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:53:22.028614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa117fb8-37b4-44b2-b754-61bbd737ceae None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:22.028915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa117fb8-37b4-44b2-b754-61bbd737ceae None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:22.029205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa117fb8-37b4-44b2-b754-61bbd737ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:22.048294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fa117fb8-37b4-44b2-b754-61bbd737ceae None None] MFA Rules not processed for user `87a7fb173c0e439290808a6f9e1616f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:53:22.049507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fa117fb8-37b4-44b2-b754-61bbd737ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:22.059691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1158/2250] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:53:22.070377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8c5b-1b59-46ca-8a1e-2ad7be95e2a5 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:22.081567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8c5b-1b59-46ca-8a1e-2ad7be95e2a5 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:22.085933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d783ed-6a10-4363-abd8-8fb2bfecd0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:22.086692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d783ed-6a10-4363-abd8-8fb2bfecd0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:22.087156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d783ed-6a10-4363-abd8-8fb2bfecd0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:22.087306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d783ed-6a10-4363-abd8-8fb2bfecd0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:22.102901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d783ed-6a10-4363-abd8-8fb2bfecd0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:22.104395 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d783ed-6a10-4363-abd8-8fb2bfecd0d0 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:22.115443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1093/2251] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:32.043164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=12 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:32.110452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=37 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:43.561046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa117fb8-37b4-44b2-b754-61bbd737ceae None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:43.573170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa117fb8-37b4-44b2-b754-61bbd737ceae None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:43.578704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:43.579393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:43.579686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:43.579971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:43.581736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:43.640061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:43.641664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:43.651491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1159/2252] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:48.313936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854305-e5dd-4f8f-acbc-eba3ca3d5d62 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:48.314456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854305-e5dd-4f8f-acbc-eba3ca3d5d62 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:48.314660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854305-e5dd-4f8f-acbc-eba3ca3d5d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:48.332997 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-fb854305-e5dd-4f8f-acbc-eba3ca3d5d62 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:53:48.334200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-fb854305-e5dd-4f8f-acbc-eba3ca3d5d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:48.394736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1094/2253] 10.222.0.43 () {58 vars in 967 bytes} [Mon Jun 20 18:53:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:53:48.450742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:48.452247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:48.537550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff107-d6b8-4b3f-a068-d911f0bbe000 service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:48.542944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c08c4-60cc-427b-9534-7a0be820a569 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:48.543657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c08c4-60cc-427b-9534-7a0be820a569 service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:48.543946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c08c4-60cc-427b-9534-7a0be820a569 service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:48.544227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c08c4-60cc-427b-9534-7a0be820a569 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:48.552819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c08c4-60cc-427b-9534-7a0be820a569 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:48.555085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c08c4-60cc-427b-9534-7a0be820a569 service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:48.563239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1160/2254] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:53:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 18:53:48.942160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854305-e5dd-4f8f-acbc-eba3ca3d5d62 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:48.951657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854305-e5dd-4f8f-acbc-eba3ca3d5d62 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:48.955257 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eb400-1a5a-484b-bf70-100a3645707c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:48.955904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb400-1a5a-484b-bf70-100a3645707c service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:48.956197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb400-1a5a-484b-bf70-100a3645707c service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:48.956479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb400-1a5a-484b-bf70-100a3645707c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:48.958348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-619eb400-1a5a-484b-bf70-100a3645707c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:49.028743 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eb400-1a5a-484b-bf70-100a3645707c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:49.030321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eb400-1a5a-484b-bf70-100a3645707c service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:49.041399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1095/2255] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:53:52.117752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164db1-8102-4018-b9b0-2a3a02243a2f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:52.118300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164db1-8102-4018-b9b0-2a3a02243a2f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:52.118409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164db1-8102-4018-b9b0-2a3a02243a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:52.136720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e4164db1-8102-4018-b9b0-2a3a02243a2f None None] MFA Rules not processed for user `016cfd43630b42f38efcd37ea9a66a10`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:53:52.137968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e4164db1-8102-4018-b9b0-2a3a02243a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:52.145096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1161/2256] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:53:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:53:56.752490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e377-0430-4b4e-9376-2bb88b07da05 None None] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:56.752998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e377-0430-4b4e-9376-2bb88b07da05 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:56.753336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e377-0430-4b4e-9376-2bb88b07da05 None None] PATH_INFO: `/` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:56.754752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1096/2257] 10.222.0.43 () {54 vars in 921 bytes} [Mon Jun 20 18:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 18:53:56.771983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:56.772473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:56.772737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:56.809767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] MFA Rules not processed for user `3adb6160201d4470a90f3fddc3d6b043`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:53:56.810931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:56.820394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1162/2258] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Jun 20 18:53:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:53:56.841259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7e377-0430-4b4e-9376-2bb88b07da05 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:56.843101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-72a7e377-0430-4b4e-9376-2bb88b07da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:56.861044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7e377-0430-4b4e-9376-2bb88b07da05 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:56.865070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:56.868391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:56.871462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:56.872118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:56.872410 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:56.872696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:56.883831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:56.885431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:56.886185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7b964-058c-442a-bead-b85a7203a435 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:56.890759 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:56.891676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:56.891968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:56.892252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] PATH_INFO: `/v3/users/b98488d018b04b34a6758f8b55925316` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:56.893466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98488d018b04b34a6758f8b55925316)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:56.895393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1097/2259] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:53:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:53:56.895610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:56.942959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:56.945474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98488d018b04b34a6758f8b55925316'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:56.953946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98488d018b04b34a6758f8b55925316'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:56.954606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98488d018b04b34a6758f8b55925316'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:56.961519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98488d018b04b34a6758f8b55925316'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:56.973073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98488d018b04b34a6758f8b55925316'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:56.979456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1163/2260] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:53:56 2022] DELETE /identity/v3/users/b98488d018b04b34a6758f8b55925316 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:53:57.152564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:57.164810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce6ead-67c0-4e87-8d99-f88f4a85e12a service placement] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:57.220921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:57.221791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:57.222077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:57.222358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] PATH_INFO: `/v3/projects/4b52def37b964824993a0edb3abc3413` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:57.223544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b52def37b964824993a0edb3abc3413)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:57.226186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:57.255959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:53:57.271144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b52def37b964824993a0edb3abc3413', 'request_id': 'req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.278179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b52def37b964824993a0edb3abc3413', 'request_id': 'req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.283796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b52def37b964824993a0edb3abc3413', 'request_id': 'req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.295220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] The token cache is being invalidate because project 4b52def37b964824993a0edb3abc3413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:53:57.295509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.296146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.297913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1098/2261] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:53:57 2022] DELETE /identity/v3/projects/4b52def37b964824993a0edb3abc3413 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:53:57.301875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:57.304029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:57.317515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00a8b-31e8-4b5b-b60e-b8fefb1e951d admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:57.373157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:57.374038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:57.374328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:57.374610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] PATH_INFO: `/v3/users/f75574d0bfda428da53c1db716ab4ced` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:57.375820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75574d0bfda428da53c1db716ab4ced)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:57.377751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:57.423026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75574d0bfda428da53c1db716ab4ced'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.430015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75574d0bfda428da53c1db716ab4ced'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.430628 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75574d0bfda428da53c1db716ab4ced'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.437514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75574d0bfda428da53c1db716ab4ced'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.449010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75574d0bfda428da53c1db716ab4ced'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.454779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1164/2262] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:53:57 2022] DELETE /identity/v3/users/f75574d0bfda428da53c1db716ab4ced => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:53:57.632446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:53:57.634549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:53:57.650356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c64ce7-cbff-480f-8d92-9ed8c4886d2a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:53:57.706977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:53:57.707859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:53:57.708148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:53:57.708432 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] PATH_INFO: `/v3/projects/dc8a637cd7ab41e2848fae0f5c879254` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:53:57.710163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8a637cd7ab41e2848fae0f5c879254)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:53:57.712108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:53:57.759156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8a637cd7ab41e2848fae0f5c879254', 'request_id': 'req-abb5b655-a3a9-442d-a8ab-c124edc47910'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.766308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8a637cd7ab41e2848fae0f5c879254', 'request_id': 'req-abb5b655-a3a9-442d-a8ab-c124edc47910'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.772501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8a637cd7ab41e2848fae0f5c879254', 'request_id': 'req-abb5b655-a3a9-442d-a8ab-c124edc47910'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.783535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] The token cache is being invalidate because project dc8a637cd7ab41e2848fae0f5c879254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:53:57.783767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.784401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:53:57.785953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1099/2263] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:53:57 2022] DELETE /identity/v3/projects/dc8a637cd7ab41e2848fae0f5c879254 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:07.451395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=66,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:07.780509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:18.472720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:18.474115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:18.542858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40ac4b-930d-4adb-bbc8-adf0a619be0f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:18.605436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:18.606112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:18.606504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:18.606615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:18.608380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:18.620992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:18.622768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:18.633548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1165/2264] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:54:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:54:28.628679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=58 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:49.256886 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:49.258463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:49.317990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5b655-a3a9-442d-a8ab-c124edc47910 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:49.321600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:49.322259 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:49.322554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:49.322844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:49.324651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:49.388166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:49.389612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:49.399131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1100/2265] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:54:52.699916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:52.699916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:52.715176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796b8ed-77cf-472a-804d-4138bd8a693c service placement] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:52.720281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:52.721263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:52.721623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:52.721971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] PATH_INFO: `/v3/users/31fed190cac24d1b8326425f737e220b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:52.723307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fed190cac24d1b8326425f737e220b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:52.725364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:52.776939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fed190cac24d1b8326425f737e220b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:52.785685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fed190cac24d1b8326425f737e220b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:52.786366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fed190cac24d1b8326425f737e220b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:52.793937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fed190cac24d1b8326425f737e220b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:52.807960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-699076f6-da6c-4efd-968c-358cab547df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fed190cac24d1b8326425f737e220b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:52.814515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1166/2266] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:54:52 2022] DELETE /identity/v3/users/31fed190cac24d1b8326425f737e220b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:52.996140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.016912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c1322-50ac-4a4a-b2b6-ad942fae4069 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.094519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.095616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.095904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.096283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] PATH_INFO: `/v3/projects/7b4a919be31b4c74a3197d98ecec7fde` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.097569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4a919be31b4c74a3197d98ecec7fde)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.100225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.151044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4a919be31b4c74a3197d98ecec7fde', 'request_id': 'req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:53.153867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:53.159433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4a919be31b4c74a3197d98ecec7fde', 'request_id': 'req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:53.169064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4a919be31b4c74a3197d98ecec7fde', 'request_id': 'req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:53.181332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] The token cache is being invalidate because project 7b4a919be31b4c74a3197d98ecec7fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:54:53.181731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:53.182406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-666a7dd6-b0be-4e41-889d-0cccbfa09ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:53.184020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1101/2267] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:54:52 2022] DELETE /identity/v3/projects/7b4a919be31b4c74a3197d98ecec7fde => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:53.190054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb5c8-dea2-43c6-bfe0-08cd4a4fff53 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.190384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb5c8-dea2-43c6-bfe0-08cd4a4fff53 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.190692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb5c8-dea2-43c6-bfe0-08cd4a4fff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.209624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-402cb5c8-dea2-43c6-bfe0-08cd4a4fff53 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:53.210824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-402cb5c8-dea2-43c6-bfe0-08cd4a4fff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:53.276799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1167/2268] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:53.284364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a3e5-8913-4f1e-9630-f8dc9ec1ad00 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.284773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a3e5-8913-4f1e-9630-f8dc9ec1ad00 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.285163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a3e5-8913-4f1e-9630-f8dc9ec1ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.304182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-f605a3e5-8913-4f1e-9630-f8dc9ec1ad00 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:53.305403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f605a3e5-8913-4f1e-9630-f8dc9ec1ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:53.313610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1102/2269] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:53.318426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cb5c8-dea2-43c6-bfe0-08cd4a4fff53 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.328107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cb5c8-dea2-43c6-bfe0-08cd4a4fff53 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.332693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.333977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.334262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.334550 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.335307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:54:53.335622 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.337259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.349611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1168/2270] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:54:53.353922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a3e5-8913-4f1e-9630-f8dc9ec1ad00 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.364061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a3e5-8913-4f1e-9630-f8dc9ec1ad00 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.369331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.370000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.370288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.370576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.371332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.373445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.411773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1103/2271] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:54:53 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:54:53.416359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.426660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2109-b018-435e-8f21-57575f21919a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.495288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.496386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.496854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.497306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.498237 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.500625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.508866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:53.533848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1169/2272] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:54:53 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:54:53.535190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.549179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b44b0-ee75-48e0-9e71-b9ef79bbb094 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.554688 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.555590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.555947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.556300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.557172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.559049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.574988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1104/2273] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:54:53.576307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.589801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7ba9b-5f89-465f-a6a0-771a81d1a940 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.600497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d758a54-0185-403c-b10f-685fe93a2f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.600892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d758a54-0185-403c-b10f-685fe93a2f8f admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.601245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d758a54-0185-403c-b10f-685fe93a2f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.601598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d758a54-0185-403c-b10f-685fe93a2f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.602410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d758a54-0185-403c-b10f-685fe93a2f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.604184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d758a54-0185-403c-b10f-685fe93a2f8f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.623307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1170/2274] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:54:53.627519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.645895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9150b-3ca4-4f5d-8014-b1cd3da6e70c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.652667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.653910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.654376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.654900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] PATH_INFO: `/v3/projects/64c2c3209e5f41ea86ef706126e95678/users/05a79187941349a09948a550bf5bddd2/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.690004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c2c3209e5f41ea86ef706126e95678, user_id=05a79187941349a09948a550bf5bddd2, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.694269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.736815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1105/2275] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:54:53 2022] PUT /identity/v3/projects/64c2c3209e5f41ea86ef706126e95678/users/05a79187941349a09948a550bf5bddd2/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:53.741468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015ff9-2369-4936-ac23-4178faeb84f5 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.741984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015ff9-2369-4936-ac23-4178faeb84f5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.742084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4015ff9-2369-4936-ac23-4178faeb84f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.778254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b4015ff9-2369-4936-ac23-4178faeb84f5 None None] MFA Rules not processed for user `05a79187941349a09948a550bf5bddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:53.779639 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b4015ff9-2369-4936-ac23-4178faeb84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:53.867230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1171/2276] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:53.867437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.932466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d1bca-b5f9-4f3c-9c48-63126db1299c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:53.937118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:53.937791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:53.938083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:53.938367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:53.939108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:53.941028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:53.969459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1106/2277] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:54:53 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:54:53.974173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015ff9-2369-4936-ac23-4178faeb84f5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:53.993335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4015ff9-2369-4936-ac23-4178faeb84f5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:54.068026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:54.069096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.069413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.069722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.070560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:54.072635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:54.099595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1172/2278] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:54:53 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:54:54.100499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:54.111062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac42915-668b-465c-8c0a-1841a375c662 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:54.116129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:54.116944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.117336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.117722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.118597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:54.120322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:54.133056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1107/2279] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:54:54.136997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:54.149006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973b69e-6b01-4c58-9efe-cd937ad4966f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:54.155712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:54.156625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.156921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.157206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] PATH_INFO: `/v3/projects/f7cf68c1259741b3b37a664b26c97657/users/eb09a62aee5d40e59d65fa7125c677de/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.176534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cf68c1259741b3b37a664b26c97657, user_id=eb09a62aee5d40e59d65fa7125c677de, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:54.180418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:54.196055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1173/2280] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:54:54 2022] PUT /identity/v3/projects/f7cf68c1259741b3b37a664b26c97657/users/eb09a62aee5d40e59d65fa7125c677de/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:54.200534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:54.212925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28dd3-002a-4b58-b0ae-599c6a652728 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:54.264936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:54.293619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3e6fb-e0be-4ea7-8cc6-a01a46706ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:54.294830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3e6fb-e0be-4ea7-8cc6-a01a46706ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.295249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3e6fb-e0be-4ea7-8cc6-a01a46706ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.295637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3e6fb-e0be-4ea7-8cc6-a01a46706ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.296602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3e6fb-e0be-4ea7-8cc6-a01a46706ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:54.298899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3e6fb-e0be-4ea7-8cc6-a01a46706ec4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:54.314928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1108/2281] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:54:54.319573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:54.335457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8d456-da41-4ceb-a97f-860da63b8dc4 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:54.349120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:54.350309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.350755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.351190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] PATH_INFO: `/v3/projects/f7cf68c1259741b3b37a664b26c97657/users/eb09a62aee5d40e59d65fa7125c677de/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.353526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cf68c1259741b3b37a664b26c97657, user_id=eb09a62aee5d40e59d65fa7125c677de, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:54.356693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:54.386692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1743867-d440-4281-a6bb-4af1699f57c8 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.387323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1743867-d440-4281-a6bb-4af1699f57c8 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.387843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1743867-d440-4281-a6bb-4af1699f57c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.410172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1174/2282] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:54:54 2022] PUT /identity/v3/projects/f7cf68c1259741b3b37a664b26c97657/users/eb09a62aee5d40e59d65fa7125c677de/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:54.431282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e1743867-d440-4281-a6bb-4af1699f57c8 None None] MFA Rules not processed for user `eb09a62aee5d40e59d65fa7125c677de`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:54.432516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e1743867-d440-4281-a6bb-4af1699f57c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:54.516879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1109/2283] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:54.528700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:54.531581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:54.556836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:54.600584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088583d7-2c73-4e25-b4ba-954406e5dbe9 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:54.604734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdb688-40a5-4c42-ace8-0cd66f528902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:54.605430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdb688-40a5-4c42-ace8-0cd66f528902 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.605723 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdb688-40a5-4c42-ace8-0cd66f528902 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.606006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdb688-40a5-4c42-ace8-0cd66f528902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.618374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdb688-40a5-4c42-ace8-0cd66f528902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:54.620303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdb688-40a5-4c42-ace8-0cd66f528902 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:54.630735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1175/2284] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:54:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:54:54.707393 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1743867-d440-4281-a6bb-4af1699f57c8 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:54.718890 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1743867-d440-4281-a6bb-4af1699f57c8 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:54.723119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:54.724220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:54.724499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:54.724887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:54.793665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:54.795170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:54.805691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1110/2285] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:54:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:54:56.121450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b40a5-7986-4857-9342-77de6508795d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:56.121906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b40a5-7986-4857-9342-77de6508795d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:56.122214 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b40a5-7986-4857-9342-77de6508795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:56.142994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-031b40a5-7986-4857-9342-77de6508795d None None] MFA Rules not processed for user `c3134832f2a647aab761da347f7e9fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:56.144383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-031b40a5-7986-4857-9342-77de6508795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:56.219102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1176/2286] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:56.535359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:56.536739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:56.593676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf5289-222d-4f11-94ab-bdcdabc660ea service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:56.597283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c7abe-9326-4932-98da-921e866c2557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:56.597936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7abe-9326-4932-98da-921e866c2557 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:56.598226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7abe-9326-4932-98da-921e866c2557 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:56.598510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7abe-9326-4932-98da-921e866c2557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:56.600293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7b4c7abe-9326-4932-98da-921e866c2557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:56.609441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c7abe-9326-4932-98da-921e866c2557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:56.610855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c7abe-9326-4932-98da-921e866c2557 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:56.619160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1111/2287] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:54:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:54:57.555255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b40a5-7986-4857-9342-77de6508795d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:57.619329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b40a5-7986-4857-9342-77de6508795d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:57.623790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:57.624663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:57.624948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:57.625229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] PATH_INFO: `/v3/users/05a79187941349a09948a550bf5bddd2` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:57.626400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a79187941349a09948a550bf5bddd2)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:57.628338 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:57.673394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a79187941349a09948a550bf5bddd2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:57.682308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a79187941349a09948a550bf5bddd2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:57.682948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a79187941349a09948a550bf5bddd2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:57.690111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a79187941349a09948a550bf5bddd2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:57.695953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:57.704121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a79187941349a09948a550bf5bddd2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:57.710792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1177/2288] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:54:57 2022] DELETE /identity/v3/users/05a79187941349a09948a550bf5bddd2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:57.715335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:57.715813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:57.715913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:57.725141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:57.736006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:57.737246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:57.800581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1112/2289] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:57.810819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:57.812192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:57.875376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f9e6-a097-41ea-9ab6-4e5099ced771 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:57.879315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:57.880009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:57.880300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:57.880578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:57.890032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:57.891595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:57.901312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1178/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:54:58.489712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:58.491193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:58.503307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08560f-64d8-481f-aeab-ceff3d74a603 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:58.508534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:58.509353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:58.509646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:58.509929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] PATH_INFO: `/v3/projects/64c2c3209e5f41ea86ef706126e95678` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:58.511242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c2c3209e5f41ea86ef706126e95678)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:58.513152 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:58.571188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c2c3209e5f41ea86ef706126e95678', 'request_id': 'req-42c90b8d-6ea4-4986-986f-b40d54f89ff2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.581582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c2c3209e5f41ea86ef706126e95678', 'request_id': 'req-42c90b8d-6ea4-4986-986f-b40d54f89ff2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.588960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c2c3209e5f41ea86ef706126e95678', 'request_id': 'req-42c90b8d-6ea4-4986-986f-b40d54f89ff2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.602718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] The token cache is being invalidate because project 64c2c3209e5f41ea86ef706126e95678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:54:58.602976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.603618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.605263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1113/2291] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:54:58 2022] DELETE /identity/v3/projects/64c2c3209e5f41ea86ef706126e95678 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:58.609330 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:58.619862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70246691-0bda-4887-a437-5eb66e0978cc service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:58.684685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:58.685579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:58.685868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:58.686149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] PATH_INFO: `/v3/users/eb09a62aee5d40e59d65fa7125c677de` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:58.687425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb09a62aee5d40e59d65fa7125c677de)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:58.689349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:58.743451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb09a62aee5d40e59d65fa7125c677de'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.751239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb09a62aee5d40e59d65fa7125c677de'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.751898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb09a62aee5d40e59d65fa7125c677de'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.760386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb09a62aee5d40e59d65fa7125c677de'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.774018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60de9082-0029-4739-92de-386c331daca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb09a62aee5d40e59d65fa7125c677de'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:58.786370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1179/2292] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:54:58 2022] DELETE /identity/v3/users/eb09a62aee5d40e59d65fa7125c677de => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:59.535521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:59.537697 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:59.551340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c90b8d-6ea4-4986-986f-b40d54f89ff2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:59.629820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:59.630984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:59.631346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:59.632041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] PATH_INFO: `/v3/projects/f7cf68c1259741b3b37a664b26c97657` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:59.632906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cf68c1259741b3b37a664b26c97657)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:59.634958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:59.687693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:59.707280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cf68c1259741b3b37a664b26c97657', 'request_id': 'req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:59.719418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cf68c1259741b3b37a664b26c97657', 'request_id': 'req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:59.736738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cf68c1259741b3b37a664b26c97657', 'request_id': 'req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:59.750226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] The token cache is being invalidate because project f7cf68c1259741b3b37a664b26c97657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:54:59.750651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:59.751462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-aed14ee3-ecc4-458e-8df9-f4ed0e2f5af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:54:59.754959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1114/2293] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:54:59 2022] DELETE /identity/v3/projects/f7cf68c1259741b3b37a664b26c97657 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:54:59.758374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03952f50-73c9-47ba-9a89-6e05999a057f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:59.758895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03952f50-73c9-47ba-9a89-6e05999a057f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:59.759027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03952f50-73c9-47ba-9a89-6e05999a057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:59.782085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-03952f50-73c9-47ba-9a89-6e05999a057f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:59.783544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-03952f50-73c9-47ba-9a89-6e05999a057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:59.791712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:54:59.869798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1180/2294] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:59.878637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787fd0-4f1a-45d0-b168-e795e8af208e None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:59.879160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787fd0-4f1a-45d0-b168-e795e8af208e None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:59.879543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787fd0-4f1a-45d0-b168-e795e8af208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:59.899774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-91787fd0-4f1a-45d0-b168-e795e8af208e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:54:59.901177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-91787fd0-4f1a-45d0-b168-e795e8af208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:54:59.909765 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1115/2295] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:54:59.914672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03952f50-73c9-47ba-9a89-6e05999a057f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:59.924903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03952f50-73c9-47ba-9a89-6e05999a057f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:59.930658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786de94-2031-474d-97db-09278e728389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:59.931513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786de94-2031-474d-97db-09278e728389 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:59.931787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786de94-2031-474d-97db-09278e728389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:59.932073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786de94-2031-474d-97db-09278e728389 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:59.932824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786de94-2031-474d-97db-09278e728389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:54:59.933141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786de94-2031-474d-97db-09278e728389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:59.935492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786de94-2031-474d-97db-09278e728389 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:54:59.954904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1181/2296] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:54:59.956912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91787fd0-4f1a-45d0-b168-e795e8af208e None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:54:59.967555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91787fd0-4f1a-45d0-b168-e795e8af208e None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:54:59.974148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:54:59.975032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:54:59.975345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:54:59.975773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:54:59.976344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:54:59.978365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.029680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1116/2297] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:54:59 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:00.034249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786de94-2031-474d-97db-09278e728389 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.046198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786de94-2031-474d-97db-09278e728389 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.110459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.111295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.111689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.112080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.112897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.115802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.137817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1182/2298] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:55:00 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:00.142280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.153872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88746d7f-f7dd-41b3-9f19-1274a6e25e74 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.159024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.160386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.160674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.161491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.162246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.164153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.175977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1117/2299] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:55:00.180961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.196924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f577e-f733-4906-a57a-57d2044697a1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.204026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd1a0-ecfe-4d3e-b2bb-d9f46146a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.205041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd1a0-ecfe-4d3e-b2bb-d9f46146a3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.205491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd1a0-ecfe-4d3e-b2bb-d9f46146a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.205922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd1a0-ecfe-4d3e-b2bb-d9f46146a3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.207123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd1a0-ecfe-4d3e-b2bb-d9f46146a3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.209749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd1a0-ecfe-4d3e-b2bb-d9f46146a3a7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.228673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1183/2300] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:00.229833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.240451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63b74a-2f8a-4a71-aeff-b05122d32638 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.245177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.246019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.246327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.246600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] PATH_INFO: `/v3/projects/9831f92c4b1f4401b111bbcb47454298/users/b55f5594c441487f820f33241093cf6d/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.263292 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9831f92c4b1f4401b111bbcb47454298, user_id=b55f5594c441487f820f33241093cf6d, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.265966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.279733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1118/2301] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:00 2022] PUT /identity/v3/projects/9831f92c4b1f4401b111bbcb47454298/users/b55f5594c441487f820f33241093cf6d/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:55:00.292114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798121ed-c0ce-4f13-84e4-12eab91d777b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.292418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798121ed-c0ce-4f13-84e4-12eab91d777b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.292729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798121ed-c0ce-4f13-84e4-12eab91d777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.320548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-798121ed-c0ce-4f13-84e4-12eab91d777b None None] MFA Rules not processed for user `b55f5594c441487f820f33241093cf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:00.321876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-798121ed-c0ce-4f13-84e4-12eab91d777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:00.388419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1184/2302] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:00.393078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.457310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebce72-d02e-4eac-943a-eb160ced7efe admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.462421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.463125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.463422 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.463710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.464421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.466328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.492376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1119/2303] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:55:00 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:00.496530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798121ed-c0ce-4f13-84e4-12eab91d777b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.503419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:00.508302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798121ed-c0ce-4f13-84e4-12eab91d777b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.564832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.565506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.565796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.566081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.566777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.568750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.589199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1185/2304] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:55:00 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:00.593202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.604141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3582e5-17f2-4c84-b726-09652acc56a5 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.608820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.609479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.609767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.610047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.610772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.612400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.622703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1120/2305] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:00.626607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.636653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a777c-d57d-4e9b-bc87-4f552bc4b582 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.641523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.642278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.642665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.642841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] PATH_INFO: `/v3/projects/893a315a37b6428b93826d869102d7d7/users/b5cd01be3a5a4b98a1db36fe9ee60b37/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.658173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893a315a37b6428b93826d869102d7d7, user_id=b5cd01be3a5a4b98a1db36fe9ee60b37, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.661416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.674627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1186/2306] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:00 2022] PUT /identity/v3/projects/893a315a37b6428b93826d869102d7d7/users/b5cd01be3a5a4b98a1db36fe9ee60b37/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:00.678543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.689034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6256658-ac5f-4e21-b969-2f98c1e5eff4 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.716570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:00.750699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eac60-073c-4aa2-964f-161742899f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.751412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eac60-073c-4aa2-964f-161742899f67 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.751706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eac60-073c-4aa2-964f-161742899f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.751974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eac60-073c-4aa2-964f-161742899f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.752703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26eac60-073c-4aa2-964f-161742899f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.754305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26eac60-073c-4aa2-964f-161742899f67 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.764746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1121/2307] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:00.768719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.780614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019849d-beea-4816-aa31-09d206b36016 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.784915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.785815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.786107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.786392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] PATH_INFO: `/v3/projects/893a315a37b6428b93826d869102d7d7/users/b5cd01be3a5a4b98a1db36fe9ee60b37/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.788423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893a315a37b6428b93826d869102d7d7, user_id=b5cd01be3a5a4b98a1db36fe9ee60b37, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.791378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:00.801706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1187/2308] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:00 2022] PUT /identity/v3/projects/893a315a37b6428b93826d869102d7d7/users/b5cd01be3a5a4b98a1db36fe9ee60b37/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:55:00.811921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa677c6-973f-4a3c-b700-67c82af05189 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.812326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa677c6-973f-4a3c-b700-67c82af05189 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.812617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa677c6-973f-4a3c-b700-67c82af05189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.839123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2fa677c6-973f-4a3c-b700-67c82af05189 None None] MFA Rules not processed for user `b5cd01be3a5a4b98a1db36fe9ee60b37`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:00.840315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2fa677c6-973f-4a3c-b700-67c82af05189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:00.909466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1122/2309] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:00.920218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:00.921929 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:00.981668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1ecc-c85d-4980-ab3d-cc9b782111f1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:00.985279 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97b5d3-50c7-41f0-bf2c-6e28d8cb583a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:00.985932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97b5d3-50c7-41f0-bf2c-6e28d8cb583a service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:00.986220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97b5d3-50c7-41f0-bf2c-6e28d8cb583a service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:00.986500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97b5d3-50c7-41f0-bf2c-6e28d8cb583a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:00.995677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97b5d3-50c7-41f0-bf2c-6e28d8cb583a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:00.997107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97b5d3-50c7-41f0-bf2c-6e28d8cb583a service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:01.007277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1188/2310] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:01.518415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa677c6-973f-4a3c-b700-67c82af05189 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:01.581115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa677c6-973f-4a3c-b700-67c82af05189 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:01.585828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:01.586738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:01.587061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:01.587345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] PATH_INFO: `/v3/users/b55f5594c441487f820f33241093cf6d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:01.588532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55f5594c441487f820f33241093cf6d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:01.590573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:01.635938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55f5594c441487f820f33241093cf6d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:01.640398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:01.644082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55f5594c441487f820f33241093cf6d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:01.652376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55f5594c441487f820f33241093cf6d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:01.653010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55f5594c441487f820f33241093cf6d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:01.653615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55f5594c441487f820f33241093cf6d'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:01.671454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1123/2311] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:01 2022] DELETE /identity/v3/users/b55f5594c441487f820f33241093cf6d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:01.675949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:01.676250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:01.676638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:01.694262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:01.695496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:01.744822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:01.754124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1189/2312] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:01.764131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:01.765537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:01.823598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a028963-81ca-4dbf-b565-1e9a23e1ef2e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:01.827251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:01.827913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:01.828207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:01.828493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:01.838341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:01.839796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:01.850058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1124/2313] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:02.281479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:02.283317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:02.297093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39295-b3ea-4dac-bc5e-fd41751af77b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:02.301747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:02.302635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:02.302907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:02.303429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] PATH_INFO: `/v3/projects/9831f92c4b1f4401b111bbcb47454298` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:02.304625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9831f92c4b1f4401b111bbcb47454298)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:02.306593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:02.353198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9831f92c4b1f4401b111bbcb47454298', 'request_id': 'req-6c5e2933-560a-4f16-bd2c-7905825c21dd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.360593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9831f92c4b1f4401b111bbcb47454298', 'request_id': 'req-6c5e2933-560a-4f16-bd2c-7905825c21dd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.366281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9831f92c4b1f4401b111bbcb47454298', 'request_id': 'req-6c5e2933-560a-4f16-bd2c-7905825c21dd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.377034 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] The token cache is being invalidate because project 9831f92c4b1f4401b111bbcb47454298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:02.377323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.377954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.380025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1190/2314] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:02 2022] DELETE /identity/v3/projects/9831f92c4b1f4401b111bbcb47454298 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:02.384047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:02.394335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da365b05-911c-4bc4-bb95-0dd1097b7d20 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:02.449440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:02.450328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:02.450619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:02.451028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] PATH_INFO: `/v3/users/b5cd01be3a5a4b98a1db36fe9ee60b37` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:02.452124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cd01be3a5a4b98a1db36fe9ee60b37)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:02.454048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:02.498321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cd01be3a5a4b98a1db36fe9ee60b37'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.505694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cd01be3a5a4b98a1db36fe9ee60b37'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.513689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cd01be3a5a4b98a1db36fe9ee60b37'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.514340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cd01be3a5a4b98a1db36fe9ee60b37'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.514973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-518f2560-b100-4c5c-9fc0-acf9255cd6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cd01be3a5a4b98a1db36fe9ee60b37'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.523446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:02.534458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1125/2315] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:02 2022] DELETE /identity/v3/users/b5cd01be3a5a4b98a1db36fe9ee60b37 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:02.839999 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:02.841578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:02.856144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2933-560a-4f16-bd2c-7905825c21dd admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:02.919371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:02.920262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:02.920552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:02.920834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] PATH_INFO: `/v3/projects/893a315a37b6428b93826d869102d7d7` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:02.922051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=893a315a37b6428b93826d869102d7d7)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:02.924032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:02.976370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893a315a37b6428b93826d869102d7d7', 'request_id': 'req-2d458291-86f4-4ae9-b637-04cf87fbbdf4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.985117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893a315a37b6428b93826d869102d7d7', 'request_id': 'req-2d458291-86f4-4ae9-b637-04cf87fbbdf4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:02.992302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893a315a37b6428b93826d869102d7d7', 'request_id': 'req-2d458291-86f4-4ae9-b637-04cf87fbbdf4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:03.003998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] The token cache is being invalidate because project 893a315a37b6428b93826d869102d7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:03.004203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:03.004867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2d458291-86f4-4ae9-b637-04cf87fbbdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:03.009831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1191/2316] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:02 2022] DELETE /identity/v3/projects/893a315a37b6428b93826d869102d7d7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:03.012764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c30ec2-47d1-46bb-8461-ae0c7bc06974 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.013276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c30ec2-47d1-46bb-8461-ae0c7bc06974 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.013543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c30ec2-47d1-46bb-8461-ae0c7bc06974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.034671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-f9c30ec2-47d1-46bb-8461-ae0c7bc06974 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:03.037149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f9c30ec2-47d1-46bb-8461-ae0c7bc06974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:03.118771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1126/2317] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:55:03.128007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357267e6-ed73-434c-9730-dc12a52013d9 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.128429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357267e6-ed73-434c-9730-dc12a52013d9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.128818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357267e6-ed73-434c-9730-dc12a52013d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.147792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-357267e6-ed73-434c-9730-dc12a52013d9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:03.149245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-357267e6-ed73-434c-9730-dc12a52013d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:03.158267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1192/2318] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:03.163369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c30ec2-47d1-46bb-8461-ae0c7bc06974 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:03.174252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c30ec2-47d1-46bb-8461-ae0c7bc06974 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:03.179856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:03.180615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.180827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.181179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.181851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:55:03.182158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:03.183867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:03.197411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1127/2319] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:55:03.201627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357267e6-ed73-434c-9730-dc12a52013d9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:03.210864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357267e6-ed73-434c-9730-dc12a52013d9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:03.215506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:03.216165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.216453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.216737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.217436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:03.219386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:03.222570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:03.247538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1193/2320] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:55:03 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:03.251806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:03.261620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184518c0-4391-4a52-a076-389df7597571 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:03.319734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:03.320502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.320933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.321208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.321966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:03.324002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:03.349284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1128/2321] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:55:03 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:03.350454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:03.360813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb45ed8-c54f-44b9-b3c0-5e4201865674 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:03.365838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:03.366505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.366794 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.367107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.367836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:03.369430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:03.379532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1194/2322] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:55:03.383489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:03.393764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16763935-c4c6-43a3-9061-35b10f6996bd admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:03.399221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc6e1-ffbd-4986-8a97-bc29a4291efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:03.399891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc6e1-ffbd-4986-8a97-bc29a4291efe admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.400178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc6e1-ffbd-4986-8a97-bc29a4291efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.400459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc6e1-ffbd-4986-8a97-bc29a4291efe admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.401186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adc6e1-ffbd-4986-8a97-bc29a4291efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:03.404701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adc6e1-ffbd-4986-8a97-bc29a4291efe admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:03.418667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1129/2323] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:03.419869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:03.430225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd403c-3260-4944-a2ab-3c021ebfcc96 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:03.435297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:03.436297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.436665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.437032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] PATH_INFO: `/v3/projects/53e09679de5144aca32878ecdde02242/users/0da028b6fe294544a690668ac5dbdb07/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.452883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e09679de5144aca32878ecdde02242, user_id=0da028b6fe294544a690668ac5dbdb07, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:03.455673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:03.468925 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1195/2324] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:03 2022] PUT /identity/v3/projects/53e09679de5144aca32878ecdde02242/users/0da028b6fe294544a690668ac5dbdb07/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:55:03.474745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2f1e-0b5d-40c7-9fe0-f2f750ab34de None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.475083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2f1e-0b5d-40c7-9fe0-f2f750ab34de None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.475376 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2f1e-0b5d-40c7-9fe0-f2f750ab34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.492793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-907e2f1e-0b5d-40c7-9fe0-f2f750ab34de None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:03.493993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-907e2f1e-0b5d-40c7-9fe0-f2f750ab34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:03.542538 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:03.553466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1130/2325] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:03.563171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:03.564932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:03.626551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db88c7-2478-474e-bf84-f9925adf06a5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:03.630168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:03.630813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:03.631127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:03.631408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:03.640297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:03.641729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:03.651475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1196/2326] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:04.235547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74967994-1b4a-4b14-826c-946a9f4ea387 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:04.236036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74967994-1b4a-4b14-826c-946a9f4ea387 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:04.236161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74967994-1b4a-4b14-826c-946a9f4ea387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:04.264559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-74967994-1b4a-4b14-826c-946a9f4ea387 None None] MFA Rules not processed for user `0da028b6fe294544a690668ac5dbdb07`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:04.265769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-74967994-1b4a-4b14-826c-946a9f4ea387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:04.338026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1131/2327] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:04.342511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:04.353524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad114b-f350-4fee-80af-17b1608cd1a1 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:04.359915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:04.360451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:04.360745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:04.361031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:04.361809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:04.363715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:04.393300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1197/2328] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:55:04 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:04.397775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74967994-1b4a-4b14-826c-946a9f4ea387 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:04.408601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74967994-1b4a-4b14-826c-946a9f4ea387 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:04.464654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:04.465451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:04.465747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:04.466037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:04.466774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:04.468977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:04.493043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1132/2329] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:55:04 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:04.494297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:04.508091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167092b-924f-4b03-acc1-60a069891d95 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:04.513350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:04.514046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:04.514342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:04.514701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:04.515888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:04.518334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:04.534001 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1198/2330] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:04.537986 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:04.548131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebaf77-dca5-499a-adce-79b5f66642de admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:04.552904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:04.553848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:04.554139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:04.554418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] PATH_INFO: `/v3/projects/cec0bc3e15ef4716ab3274f2efd36ccc/users/770e7252f137415f9f267eddceb7d875/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:04.570454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec0bc3e15ef4716ab3274f2efd36ccc, user_id=770e7252f137415f9f267eddceb7d875, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:04.573159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:04.588728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1133/2331] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:04 2022] PUT /identity/v3/projects/cec0bc3e15ef4716ab3274f2efd36ccc/users/770e7252f137415f9f267eddceb7d875/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:04.592877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:04.603442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104900-cb8f-4baa-8150-d7e49018a262 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:04.660305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eade5-c80f-4daf-9fe0-9db7aa1e1153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:04.661011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eade5-c80f-4daf-9fe0-9db7aa1e1153 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:04.661305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eade5-c80f-4daf-9fe0-9db7aa1e1153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:04.661592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eade5-c80f-4daf-9fe0-9db7aa1e1153 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:04.662327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eade5-c80f-4daf-9fe0-9db7aa1e1153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:04.664231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eade5-c80f-4daf-9fe0-9db7aa1e1153 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:04.673636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1199/2332] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:04.677750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:04.687865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11be46f-bc78-4460-89a5-a5796fe16bd5 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:04.692912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:04.693785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:04.694073 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:04.694359 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] PATH_INFO: `/v3/projects/cec0bc3e15ef4716ab3274f2efd36ccc/users/770e7252f137415f9f267eddceb7d875/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:04.696421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec0bc3e15ef4716ab3274f2efd36ccc, user_id=770e7252f137415f9f267eddceb7d875, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:04.699086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:04.709789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1134/2333] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:04 2022] PUT /identity/v3/projects/cec0bc3e15ef4716ab3274f2efd36ccc/users/770e7252f137415f9f267eddceb7d875/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:55:05.336896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e47c-1754-4efe-8594-e9dc2e7fe755 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:05.337200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e47c-1754-4efe-8594-e9dc2e7fe755 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:05.337489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e47c-1754-4efe-8594-e9dc2e7fe755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:05.365252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f5c4e47c-1754-4efe-8594-e9dc2e7fe755 None None] MFA Rules not processed for user `770e7252f137415f9f267eddceb7d875`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:05.367336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f5c4e47c-1754-4efe-8594-e9dc2e7fe755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:05.371403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:05.458993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1200/2334] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:05.464511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:05.466319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:05.521013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:05.540729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70f60-b571-41d0-9223-bdd62e239c56 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:05.545095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212e531-61b7-47ff-8019-b1dd1e4f49bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:05.545875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e531-61b7-47ff-8019-b1dd1e4f49bb service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:05.546206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e531-61b7-47ff-8019-b1dd1e4f49bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:05.546726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212e531-61b7-47ff-8019-b1dd1e4f49bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:05.614652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212e531-61b7-47ff-8019-b1dd1e4f49bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:05.616170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212e531-61b7-47ff-8019-b1dd1e4f49bb service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:05.625482 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1135/2335] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:08.058949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4e47c-1754-4efe-8594-e9dc2e7fe755 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:08.068636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4e47c-1754-4efe-8594-e9dc2e7fe755 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:08.072127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:08.072795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:08.073082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:08.073367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:08.082313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:08.084191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:08.094190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1201/2336] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:10.265172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea9c3-19ef-4ea5-85bb-042f6e97033d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:10.265670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea9c3-19ef-4ea5-85bb-042f6e97033d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:10.265772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea9c3-19ef-4ea5-85bb-042f6e97033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:10.285277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-56fea9c3-19ef-4ea5-85bb-042f6e97033d None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:10.287394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-56fea9c3-19ef-4ea5-85bb-042f6e97033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:10.349297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1136/2337] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:55:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:10.403066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:10.404973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:10.506850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b05453-44ba-4d7d-9154-bcc9a56a734b service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:10.512312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:10.513202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:10.513599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:10.513988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:10.526745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:10.528819 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:10.543655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1202/2338] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:55:20.341813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=55 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:20.536804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=65 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:21.662937 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fea9c3-19ef-4ea5-85bb-042f6e97033d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:21.744312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fea9c3-19ef-4ea5-85bb-042f6e97033d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:21.749878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:21.750820 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:21.751145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:21.751433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] PATH_INFO: `/v3/users/0da028b6fe294544a690668ac5dbdb07` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:21.752668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da028b6fe294544a690668ac5dbdb07)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:21.755859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:21.812658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da028b6fe294544a690668ac5dbdb07'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:21.820363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da028b6fe294544a690668ac5dbdb07'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:21.829032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da028b6fe294544a690668ac5dbdb07'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:21.829805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da028b6fe294544a690668ac5dbdb07'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:21.830510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da028b6fe294544a690668ac5dbdb07'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:21.848774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1137/2339] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:21 2022] DELETE /identity/v3/users/0da028b6fe294544a690668ac5dbdb07 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:22.020724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:22.031535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122291-b015-4e59-89ee-48b6d058492c service swift] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:22.088712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:22.089587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.089875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.090157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] PATH_INFO: `/v3/projects/53e09679de5144aca32878ecdde02242` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.091358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e09679de5144aca32878ecdde02242)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:22.093255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:22.137471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e09679de5144aca32878ecdde02242', 'request_id': 'req-1e361a4d-f971-4593-b316-e7ca647824b3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.143693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e09679de5144aca32878ecdde02242', 'request_id': 'req-1e361a4d-f971-4593-b316-e7ca647824b3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.149591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e09679de5144aca32878ecdde02242', 'request_id': 'req-1e361a4d-f971-4593-b316-e7ca647824b3'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.161183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] The token cache is being invalidate because project 53e09679de5144aca32878ecdde02242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:22.161473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.162134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.163726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1203/2340] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:22 2022] DELETE /identity/v3/projects/53e09679de5144aca32878ecdde02242 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:55:22.167852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:22.169241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:22.182002 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61e36a-fdbd-4c4b-b1e7-5876ec98c9dc admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:22.237226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:22.238146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.238479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.238763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] PATH_INFO: `/v3/users/770e7252f137415f9f267eddceb7d875` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.240035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=770e7252f137415f9f267eddceb7d875)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:22.241999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:22.265745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:22.291149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770e7252f137415f9f267eddceb7d875'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.297896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770e7252f137415f9f267eddceb7d875'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.305139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770e7252f137415f9f267eddceb7d875'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.305834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770e7252f137415f9f267eddceb7d875'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.306502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d9b34e8c-bca3-4fbd-afd2-29c83f898497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770e7252f137415f9f267eddceb7d875'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.324157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1138/2341] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:22 2022] DELETE /identity/v3/users/770e7252f137415f9f267eddceb7d875 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:22.497464 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:22.499151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:22.512905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361a4d-f971-4593-b316-e7ca647824b3 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:22.570380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:22.571289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.571581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.571866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] PATH_INFO: `/v3/projects/cec0bc3e15ef4716ab3274f2efd36ccc` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.573051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec0bc3e15ef4716ab3274f2efd36ccc)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:22.574993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:22.609609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:22.623417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec0bc3e15ef4716ab3274f2efd36ccc', 'request_id': 'req-ca334d5d-df8c-42f8-81ba-72507bd27ed0'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.631101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec0bc3e15ef4716ab3274f2efd36ccc', 'request_id': 'req-ca334d5d-df8c-42f8-81ba-72507bd27ed0'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.636593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec0bc3e15ef4716ab3274f2efd36ccc', 'request_id': 'req-ca334d5d-df8c-42f8-81ba-72507bd27ed0'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.647936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] The token cache is being invalidate because project cec0bc3e15ef4716ab3274f2efd36ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:22.648222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.648849 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ca334d5d-df8c-42f8-81ba-72507bd27ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:22.650369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1204/2342] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:22 2022] DELETE /identity/v3/projects/cec0bc3e15ef4716ab3274f2efd36ccc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:22.656178 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a181f-82ca-4a1c-972b-16daa5d50a1d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.656474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a181f-82ca-4a1c-972b-16daa5d50a1d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.656760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a181f-82ca-4a1c-972b-16daa5d50a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.674699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-427a181f-82ca-4a1c-972b-16daa5d50a1d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:22.675937 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-427a181f-82ca-4a1c-972b-16daa5d50a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:22.733691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1139/2343] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:55:22.741525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bd5ec-db63-4ff5-bc77-a2ae5f3ca09f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.741755 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bd5ec-db63-4ff5-bc77-a2ae5f3ca09f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.742039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bd5ec-db63-4ff5-bc77-a2ae5f3ca09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.760240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-d53bd5ec-db63-4ff5-bc77-a2ae5f3ca09f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:22.761425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d53bd5ec-db63-4ff5-bc77-a2ae5f3ca09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:22.769175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1205/2344] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:22.773258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a181f-82ca-4a1c-972b-16daa5d50a1d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:22.782759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a181f-82ca-4a1c-972b-16daa5d50a1d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:22.788015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:22.788696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.789239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.789519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.790244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:55:22.790558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:22.792223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:22.804154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1140/2345] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:55:22.808535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bd5ec-db63-4ff5-bc77-a2ae5f3ca09f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:22.818438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bd5ec-db63-4ff5-bc77-a2ae5f3ca09f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:22.823311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:22.823980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.824271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.824557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.825269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:22.827218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:22.854493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1206/2346] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:55:22 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:22.858790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:22.870867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e90bd-b7c5-407a-8575-ffaacc09c351 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:22.931021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:22.931703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.931992 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.932272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.932968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:22.934878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:22.964325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1141/2347] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:55:22 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:55:22.965686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:22.975893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170f3c8-c143-48b9-abbf-477582360f08 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:22.980511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:22.981168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:22.981454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:22.981731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:22.982457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:22.984081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:22.994775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1207/2348] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:22.998397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.009233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b48d6-8da4-40f7-be94-cbe3213fa1de admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.015146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0754ba-082e-41c6-a10d-1ae50b0b5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.015814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0754ba-082e-41c6-a10d-1ae50b0b5543 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.016103 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0754ba-082e-41c6-a10d-1ae50b0b5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.016513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0754ba-082e-41c6-a10d-1ae50b0b5543 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.017248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0754ba-082e-41c6-a10d-1ae50b0b5543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.018863 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0754ba-082e-41c6-a10d-1ae50b0b5543 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.028839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1142/2349] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:23.032976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.043106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdee5b-f9c4-458a-bbe2-c063995a4420 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.047677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.048556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.048844 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.049124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] PATH_INFO: `/v3/projects/a5e52b5b68114a04839c8f4f2a28b446/users/3e531dfedddd42919a1e568d85e466fe/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.063805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e52b5b68114a04839c8f4f2a28b446, user_id=3e531dfedddd42919a1e568d85e466fe, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.066530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.078995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1208/2350] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:23 2022] PUT /identity/v3/projects/a5e52b5b68114a04839c8f4f2a28b446/users/3e531dfedddd42919a1e568d85e466fe/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:23.089461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c63db-410c-4a92-b965-69bf943e4a29 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.089751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c63db-410c-4a92-b965-69bf943e4a29 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.090032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c63db-410c-4a92-b965-69bf943e4a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.096629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:23.119348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-832c63db-410c-4a92-b965-69bf943e4a29 None None] MFA Rules not processed for user `3e531dfedddd42919a1e568d85e466fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:23.120577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-832c63db-410c-4a92-b965-69bf943e4a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:23.183608 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1143/2351] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:23.188005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.248247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f80d3f-9b51-4e39-ab1f-8d22bee0b2fa admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.252749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.253401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.253690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.254498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.255223 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.257126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.281392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1209/2352] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:55:23 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:55:23.285468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c63db-410c-4a92-b965-69bf943e4a29 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.296326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c63db-410c-4a92-b965-69bf943e4a29 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.351456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.352130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.352444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.352723 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.353433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.355382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.374324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1144/2353] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:55:23 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:23.378364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.389407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4816f-9a4a-4090-8bbb-4a82b93e9ed5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.393953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.395233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.395523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.395802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.396529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.398122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.408399 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1210/2354] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:23.412215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.422738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9508b8-46f4-42cc-9eb9-757722df190e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.427414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.428301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.428593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.428879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] PATH_INFO: `/v3/projects/60087aa807014777bdce1cdb0304f123/users/161a90dce8ca4a9cb282cb3b94045597/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.443868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=60087aa807014777bdce1cdb0304f123, user_id=161a90dce8ca4a9cb282cb3b94045597, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.446514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.461455 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1145/2355] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:23 2022] PUT /identity/v3/projects/60087aa807014777bdce1cdb0304f123/users/161a90dce8ca4a9cb282cb3b94045597/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:23.465553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.475740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947597a-bb3d-4c3c-b07f-4f38e67f9e62 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.505273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:23.534924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1a5a-ccc7-4291-829b-67f74d8f2318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.535604 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1a5a-ccc7-4291-829b-67f74d8f2318 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.535888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1a5a-ccc7-4291-829b-67f74d8f2318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.536169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1a5a-ccc7-4291-829b-67f74d8f2318 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.536896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad1a5a-ccc7-4291-829b-67f74d8f2318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.538488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad1a5a-ccc7-4291-829b-67f74d8f2318 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.548517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1211/2356] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:23.552758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.562864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712389aa-c36a-4f46-9ec0-b6bc5fe712dd admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.567882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.568761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.569054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.569334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] PATH_INFO: `/v3/projects/60087aa807014777bdce1cdb0304f123/users/161a90dce8ca4a9cb282cb3b94045597/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.571339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60087aa807014777bdce1cdb0304f123, user_id=161a90dce8ca4a9cb282cb3b94045597, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.573971 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.586217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1146/2357] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:23 2022] PUT /identity/v3/projects/60087aa807014777bdce1cdb0304f123/users/161a90dce8ca4a9cb282cb3b94045597/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:23.597044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412b55-a2ff-4f11-8c97-682ed32dd769 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.597344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412b55-a2ff-4f11-8c97-682ed32dd769 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.597632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412b55-a2ff-4f11-8c97-682ed32dd769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.624534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-12412b55-a2ff-4f11-8c97-682ed32dd769 None None] MFA Rules not processed for user `161a90dce8ca4a9cb282cb3b94045597`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:23.625732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-12412b55-a2ff-4f11-8c97-682ed32dd769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:23.694058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1212/2358] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:23.705226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:23.707233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:23.760799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:23.766923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5634-8148-4511-a63e-b39ad57aae4a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:23.771201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5201a2-65ad-4a01-9dea-a8d40774b47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:23.771888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5201a2-65ad-4a01-9dea-a8d40774b47c service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:23.773439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5201a2-65ad-4a01-9dea-a8d40774b47c service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:23.773802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5201a2-65ad-4a01-9dea-a8d40774b47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:23.831471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5201a2-65ad-4a01-9dea-a8d40774b47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:23.832953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5201a2-65ad-4a01-9dea-a8d40774b47c service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:23.841751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1147/2359] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:26.362956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412b55-a2ff-4f11-8c97-682ed32dd769 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:26.427482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412b55-a2ff-4f11-8c97-682ed32dd769 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:26.432010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:26.432913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:26.433204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:26.433485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] PATH_INFO: `/v3/users/3e531dfedddd42919a1e568d85e466fe` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:26.434696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e531dfedddd42919a1e568d85e466fe)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:26.436727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:26.486247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e531dfedddd42919a1e568d85e466fe'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:26.494807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e531dfedddd42919a1e568d85e466fe'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:26.495603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e531dfedddd42919a1e568d85e466fe'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:26.497175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:26.505397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e531dfedddd42919a1e568d85e466fe'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:26.518085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e531dfedddd42919a1e568d85e466fe'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:26.525852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1213/2360] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:26 2022] DELETE /identity/v3/users/3e531dfedddd42919a1e568d85e466fe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:55:26.530151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:26.530682 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:26.530780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:26.548806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:26.550086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:26.611825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1148/2361] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:26.621221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:26.622684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:26.680779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2975c92-876c-46ed-94c9-9a70c467fe4c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:26.684427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:26.685071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:26.685360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:26.685643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:26.694827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:26.697308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:26.707533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1214/2362] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:26.990391 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:26.992498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:27.005075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e967f5-d1b9-49e3-a7da-e9a348eeadd9 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:27.010703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:27.011736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:27.012382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:27.012641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] PATH_INFO: `/v3/projects/a5e52b5b68114a04839c8f4f2a28b446` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:27.014091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e52b5b68114a04839c8f4f2a28b446)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:27.016928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:27.072075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e52b5b68114a04839c8f4f2a28b446', 'request_id': 'req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.080627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e52b5b68114a04839c8f4f2a28b446', 'request_id': 'req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.087074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e52b5b68114a04839c8f4f2a28b446', 'request_id': 'req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.098973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] The token cache is being invalidate because project a5e52b5b68114a04839c8f4f2a28b446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:27.099384 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.100051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-dc0c4dd7-49d8-448c-b1e5-c41ae3a361fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.101626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1149/2363] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:26 2022] DELETE /identity/v3/projects/a5e52b5b68114a04839c8f4f2a28b446 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:27.105696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:27.115581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef4b2a-81b4-4dd4-8844-38b9670e369c service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:27.176876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:27.177762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:27.178047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:27.178326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] PATH_INFO: `/v3/users/161a90dce8ca4a9cb282cb3b94045597` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:27.179527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=161a90dce8ca4a9cb282cb3b94045597)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:27.181456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:27.230230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161a90dce8ca4a9cb282cb3b94045597'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.237898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161a90dce8ca4a9cb282cb3b94045597'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.238642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161a90dce8ca4a9cb282cb3b94045597'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.245949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161a90dce8ca4a9cb282cb3b94045597'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.258735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:27.261605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161a90dce8ca4a9cb282cb3b94045597'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.271668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1215/2364] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:27 2022] DELETE /identity/v3/users/161a90dce8ca4a9cb282cb3b94045597 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:27.521392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:27.522170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:27.522170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:27.558094 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:27.559576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:27.578972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:27.580303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:27.609082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:27.673363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1150/2365] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:55:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:27.691129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:27.693673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57052aa-b959-4645-97f7-6d29d1f326d8 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:27.703923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:27.704092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:27.704927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:27.705391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:27.705735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] PATH_INFO: `/v3/projects/60087aa807014777bdce1cdb0304f123` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:27.707036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60087aa807014777bdce1cdb0304f123)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:27.708963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:27.797817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60087aa807014777bdce1cdb0304f123', 'request_id': 'req-ec1377fc-ecf1-4f91-aafb-237d49b14683'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.823161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60087aa807014777bdce1cdb0304f123', 'request_id': 'req-ec1377fc-ecf1-4f91-aafb-237d49b14683'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.838004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60087aa807014777bdce1cdb0304f123', 'request_id': 'req-ec1377fc-ecf1-4f91-aafb-237d49b14683'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.842063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3529fd-7115-45e7-bd47-77f5da7dc5e4 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:27.877054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] The token cache is being invalidate because project 60087aa807014777bdce1cdb0304f123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:27.877425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.878049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-ec1377fc-ecf1-4f91-aafb-237d49b14683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:27.883825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1216/2366] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:27 2022] DELETE /identity/v3/projects/60087aa807014777bdce1cdb0304f123 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:27.885539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6197-72bd-41ff-9f1f-6e0ce141e68f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:27.885843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6197-72bd-41ff-9f1f-6e0ce141e68f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:27.886139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d6197-72bd-41ff-9f1f-6e0ce141e68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:27.920847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-682d6197-72bd-41ff-9f1f-6e0ce141e68f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:27.922754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-682d6197-72bd-41ff-9f1f-6e0ce141e68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:27.960651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:27.961442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:27.961814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:27.962015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:27.964317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:28.057705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1217/2367] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:55:28.058739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.061008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.073088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd738b81-50a8-4c8a-a333-84dc8074cd59 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.073418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd738b81-50a8-4c8a-a333-84dc8074cd59 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.073668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd738b81-50a8-4c8a-a333-84dc8074cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.075881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1151/2368] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:55:28.099866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fd738b81-50a8-4c8a-a333-84dc8074cd59 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:28.103965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fd738b81-50a8-4c8a-a333-84dc8074cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:28.130008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1218/2369] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:28.133368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:28.147183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634a197-85e3-42d4-8c70-81b363916a7e service swift] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:28.152692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:28.153559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.154166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.154463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.155416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:55:28.155737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.157805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.169385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:28.179610 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd738b81-50a8-4c8a-a333-84dc8074cd59 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:28.180655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1152/2370] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:55:28.193380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd738b81-50a8-4c8a-a333-84dc8074cd59 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:28.202045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:28.202734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.203051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.203335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.215404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.217960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.234196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:28.249120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1219/2371] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:55:28 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:28.253493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:28.264793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf13f37-748b-43b2-8729-3bdac759b3a9 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:28.329540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:28.330229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.330517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.330799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.331651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.334250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.356147 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1153/2372] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:55:28 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:55:28.357356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:28.368003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b9845-f162-4b72-8e52-d842fb1f6284 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:28.372594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:28.373268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.373554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.373839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.374568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.376210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.387219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1220/2373] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:28.391206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:28.401836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c97850-87b3-4317-841a-fb02a9b85786 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:28.406582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406f87-5393-417d-947d-c3d809595efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:28.407297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406f87-5393-417d-947d-c3d809595efc admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.407642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406f87-5393-417d-947d-c3d809595efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.407940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406f87-5393-417d-947d-c3d809595efc admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.408727 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406f87-5393-417d-947d-c3d809595efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.410394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406f87-5393-417d-947d-c3d809595efc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.421061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1154/2374] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:55:28.425268 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:28.436059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b7f57-1e06-4ec9-b692-3649bf2f7167 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:28.441015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:28.442535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.442829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.443152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] PATH_INFO: `/v3/projects/68f093f367774294b6c11c9148ba73e9/users/aebcd6bca52f4cb4a788079a568169fd/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.458141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f093f367774294b6c11c9148ba73e9, user_id=aebcd6bca52f4cb4a788079a568169fd, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.460860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.474675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1221/2375] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:55:28 2022] PUT /identity/v3/projects/68f093f367774294b6c11c9148ba73e9/users/aebcd6bca52f4cb4a788079a568169fd/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:28.484575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.484881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.485165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.511507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] MFA Rules not processed for user `aebcd6bca52f4cb4a788079a568169fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:28.512710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:28.580196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1155/2376] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:55:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:28.591704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:28.593517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:28.664288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ccb5-8303-48dc-b4c9-c3554c79d35a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:28.668031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e6c2b-6a64-4ff2-9489-2394b5faf580 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880c7a0632ef44a1ab446d1bb53399fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:28.668688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e6c2b-6a64-4ff2-9489-2394b5faf580 service glance] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:28.668978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e6c2b-6a64-4ff2-9489-2394b5faf580 service glance] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:28.669261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e6c2b-6a64-4ff2-9489-2394b5faf580 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:28.678458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e6c2b-6a64-4ff2-9489-2394b5faf580 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:28.679975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e6c2b-6a64-4ff2-9489-2394b5faf580 service glance] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:28.689259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1222/2377] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:38.577082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:38.685011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=48,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:46.017078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:46.018514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:46.108420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92ba8-b2e9-4d3c-a89b-5241eb7dbf09 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:46.111953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:46.113583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:46.113810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:46.114087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:46.115866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:46.179346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:46.180781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:46.190116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1156/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:55:49.182509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:49.183560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:49.184036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:49.205440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:55:49.207347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:49.279302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1223/2379] 10.222.0.43 () {58 vars in 967 bytes} [Mon Jun 20 18:55:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:55:49.300627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:49.302667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:49.390461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc8da-880b-4484-9b89-37c761732a5d service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:49.397905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:49.400453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:49.403309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:49.404390 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:49.416344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:49.418859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:49.436392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1157/2380] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:55:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:55:52.742019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:52.743554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:52.759585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e301859-1c28-4eed-a609-84b8fb8c75a3 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:52.764263 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:52.765153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:52.765436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:52.765714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] PATH_INFO: `/v3/users/a5d3b9702e434e038466969abfae2338` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:52.767015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d3b9702e434e038466969abfae2338)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:52.769586 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:52.818103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d3b9702e434e038466969abfae2338'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:52.825498 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d3b9702e434e038466969abfae2338'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:52.826113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d3b9702e434e038466969abfae2338'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:52.834047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d3b9702e434e038466969abfae2338'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:52.845944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d3b9702e434e038466969abfae2338'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:52.852416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1224/2381] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:52 2022] DELETE /identity/v3/users/a5d3b9702e434e038466969abfae2338 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:55:53.034288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:53.047059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af021e-9540-45e5-b036-89b3d75e7f01 service swift] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:53.088932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:53.107667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:53.108544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:53.108829 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:53.109111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] PATH_INFO: `/v3/projects/afb8f33898e2408eaaac28b7f1802314` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:53.110298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb8f33898e2408eaaac28b7f1802314)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:53.112230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:53.165887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb8f33898e2408eaaac28b7f1802314', 'request_id': 'req-5be2c914-a7b5-433b-af09-0ad485d3e40c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.172958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb8f33898e2408eaaac28b7f1802314', 'request_id': 'req-5be2c914-a7b5-433b-af09-0ad485d3e40c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.179398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb8f33898e2408eaaac28b7f1802314', 'request_id': 'req-5be2c914-a7b5-433b-af09-0ad485d3e40c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.191413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] The token cache is being invalidate because project afb8f33898e2408eaaac28b7f1802314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:53.191712 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.192364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.194139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1158/2382] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:53 2022] DELETE /identity/v3/projects/afb8f33898e2408eaaac28b7f1802314 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:53.197884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:53.199360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:53.214509 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecd4ab-1788-4c2b-a064-3009d7b80bd5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:53.278865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:53.279832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:53.280128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:53.280412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] PATH_INFO: `/v3/users/3c163067ec8a4e0aa86a9bfa3e784738` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:53.283762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c163067ec8a4e0aa86a9bfa3e784738)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:53.285724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:53.308568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:53.337979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c163067ec8a4e0aa86a9bfa3e784738'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.345052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c163067ec8a4e0aa86a9bfa3e784738'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.345679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c163067ec8a4e0aa86a9bfa3e784738'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.352990 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c163067ec8a4e0aa86a9bfa3e784738'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.365056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c163067ec8a4e0aa86a9bfa3e784738'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.371287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1225/2383] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:55:53 2022] DELETE /identity/v3/users/3c163067ec8a4e0aa86a9bfa3e784738 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:55:53.561360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:55:53.563155 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:55:53.579666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2c914-a7b5-433b-af09-0ad485d3e40c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:55:53.655787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:55:53.656692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:55:53.656973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:55:53.657263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] PATH_INFO: `/v3/projects/474744b60a6244e7aa86a2fa2014ac15` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:55:53.658505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=474744b60a6244e7aa86a2fa2014ac15)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:55:53.660475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:55:53.716519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474744b60a6244e7aa86a2fa2014ac15', 'request_id': 'req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.724127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474744b60a6244e7aa86a2fa2014ac15', 'request_id': 'req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.731176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474744b60a6244e7aa86a2fa2014ac15', 'request_id': 'req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.739623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:55:53.744275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] The token cache is being invalidate because project 474744b60a6244e7aa86a2fa2014ac15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:55:53.744588 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.745499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f7c163c6-9e6e-4a8e-a43e-69c7f4499e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:55:53.750966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1159/2384] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:55:53 2022] DELETE /identity/v3/projects/474744b60a6244e7aa86a2fa2014ac15 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:03.367472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=8,keystone:SELECT=20,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:05.927226 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:05.928724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:05.941757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512556c8-1bae-4e02-a4f7-20b9e89c3a4f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:05.997917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:05.998894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:05.999300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:05.999589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] PATH_INFO: `/v3/users/aebcd6bca52f4cb4a788079a568169fd` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:06.000777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aebcd6bca52f4cb4a788079a568169fd)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:06.002701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:06.049220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aebcd6bca52f4cb4a788079a568169fd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.056590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aebcd6bca52f4cb4a788079a568169fd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.057351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aebcd6bca52f4cb4a788079a568169fd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.064582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aebcd6bca52f4cb4a788079a568169fd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.076765 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aebcd6bca52f4cb4a788079a568169fd'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.082650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1226/2385] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:05 2022] DELETE /identity/v3/users/aebcd6bca52f4cb4a788079a568169fd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:06.087175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:06.087673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:06.087766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:06.107942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:06.109131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:06.166085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1160/2386] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:06.176175 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:06.177588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:06.233673 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6c9e-a330-412e-bb5a-d00dcef271c1 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:06.238074 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:06.238722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:06.239037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:06.239319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:06.248253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:06.249688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:06.259205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1227/2387] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:06.521003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:06.522442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:06.536094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c46e8-d2fa-4d27-ad59-0670077427f0 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:06.540988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:06.541873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:06.542185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:06.542466 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] PATH_INFO: `/v3/projects/68f093f367774294b6c11c9148ba73e9` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:06.543730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f093f367774294b6c11c9148ba73e9)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:06.546488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:06.592210 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f093f367774294b6c11c9148ba73e9', 'request_id': 'req-e9446116-204a-4faf-9a9a-92c81a19acfe'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.599241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f093f367774294b6c11c9148ba73e9', 'request_id': 'req-e9446116-204a-4faf-9a9a-92c81a19acfe'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.604722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f093f367774294b6c11c9148ba73e9', 'request_id': 'req-e9446116-204a-4faf-9a9a-92c81a19acfe'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.615782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] The token cache is being invalidate because project 68f093f367774294b6c11c9148ba73e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:06.616069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.616689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:06.618194 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1161/2388] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:06 2022] DELETE /identity/v3/projects/68f093f367774294b6c11c9148ba73e9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:12.566514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:12.567990 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:12.595734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:12.628846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424ac5-45f4-43c7-835f-d39a8f569da3 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:12.675513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:12.676167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:12.676460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:12.676744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:12.678636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:12.748900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:12.750379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:12.761141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1228/2389] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:16.612324 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:17.973509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:17.974935 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:18.030111 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9446116-204a-4faf-9a9a-92c81a19acfe admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:18.033663 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:18.035024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:18.035319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:18.035600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:18.037342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:18.051286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:18.052700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:18.063620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1162/2390] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:22.756384 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=64 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:25.624090 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:25.633849 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc121-9520-4537-92ef-65d45b3d402a service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:25.637407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:25.638050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:25.638341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:25.638625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:25.640428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:25.702975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:25.704448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:25.715251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1229/2391] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:28.058854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=26 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:28.745269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:28.747036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:28.761181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b24612-adec-47af-89f1-d71d712f4638 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:28.765757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:28.766649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:28.766971 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:28.767402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] PATH_INFO: `/v3/users/016cfd43630b42f38efcd37ea9a66a10` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:28.785695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=016cfd43630b42f38efcd37ea9a66a10)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:28.787725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:28.838942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016cfd43630b42f38efcd37ea9a66a10'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:28.845676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016cfd43630b42f38efcd37ea9a66a10'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:28.852896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016cfd43630b42f38efcd37ea9a66a10'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:28.853518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016cfd43630b42f38efcd37ea9a66a10'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:28.854157 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-84af96ab-97bf-4523-9693-b87e18f8b26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016cfd43630b42f38efcd37ea9a66a10'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:28.875524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1163/2392] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:28 2022] DELETE /identity/v3/users/016cfd43630b42f38efcd37ea9a66a10 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:29.045635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.056492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d10536-9963-4dc7-b453-c81a570ed9c4 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.114728 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.115650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.115944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.116231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] PATH_INFO: `/v3/projects/e724578c7aab45bb8ae2317c33e3be33` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.126522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e724578c7aab45bb8ae2317c33e3be33)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.128592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.173817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e724578c7aab45bb8ae2317c33e3be33', 'request_id': 'req-3dfe89d2-8955-443f-b89f-192e423a0071'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:29.180900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e724578c7aab45bb8ae2317c33e3be33', 'request_id': 'req-3dfe89d2-8955-443f-b89f-192e423a0071'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:29.187100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e724578c7aab45bb8ae2317c33e3be33', 'request_id': 'req-3dfe89d2-8955-443f-b89f-192e423a0071'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:29.198897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] The token cache is being invalidate because project e724578c7aab45bb8ae2317c33e3be33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:29.199217 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:29.199886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3dfe89d2-8955-443f-b89f-192e423a0071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:29.201411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1230/2393] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:29 2022] DELETE /identity/v3/projects/e724578c7aab45bb8ae2317c33e3be33 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:29.206904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e2e8-c584-4549-a28f-8a9f2604fd24 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.207398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e2e8-c584-4549-a28f-8a9f2604fd24 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.207510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e2e8-c584-4549-a28f-8a9f2604fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.225607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e8c2e2e8-c584-4549-a28f-8a9f2604fd24 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:29.226788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e8c2e2e8-c584-4549-a28f-8a9f2604fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:29.283421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1164/2394] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:29.291435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac2c1-bb0b-4d0a-84a5-a42a4a2610a9 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.291667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac2c1-bb0b-4d0a-84a5-a42a4a2610a9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.291955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac2c1-bb0b-4d0a-84a5-a42a4a2610a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.309404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ad0ac2c1-bb0b-4d0a-84a5-a42a4a2610a9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:29.310591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ad0ac2c1-bb0b-4d0a-84a5-a42a4a2610a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:29.318908 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1231/2395] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:29.323118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2e2e8-c584-4549-a28f-8a9f2604fd24 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.333177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2e2e8-c584-4549-a28f-8a9f2604fd24 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.337708 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.338385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.338670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.338982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.339706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:29.340013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.341590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.352939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1165/2396] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:56:29.357030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac2c1-bb0b-4d0a-84a5-a42a4a2610a9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.366005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac2c1-bb0b-4d0a-84a5-a42a4a2610a9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.370544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.371228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.371516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.371797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.372481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.374365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.378820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:29.402202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1232/2397] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:29 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:29.406131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.416571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0cef-763b-456c-9b2e-3f7311e9da9f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.462013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:29.475356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.476038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.476332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.476624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.477319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.479283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.498617 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1166/2398] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:29 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:29.502415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.513108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f3f0-b7ca-4e09-96e8-ac0f3f737520 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.517630 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.518880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.519200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.519506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.520231 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.521818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.531665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1233/2399] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:29.535520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.545655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36eb8-6dd8-4531-8083-2fabab9c9f08 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.550418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed10dc-0e77-4651-8455-9bef8fd0d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.551131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed10dc-0e77-4651-8455-9bef8fd0d7ed admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.551429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed10dc-0e77-4651-8455-9bef8fd0d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.551715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed10dc-0e77-4651-8455-9bef8fd0d7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.552451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed10dc-0e77-4651-8455-9bef8fd0d7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.554089 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed10dc-0e77-4651-8455-9bef8fd0d7ed admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.564229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1167/2400] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:29.568313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.577935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f0622-05b9-4c81-9a55-a73e0eeefbde admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.583133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.584014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.584302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.584585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] PATH_INFO: `/v3/projects/1e45d76a173848f7a3e5cc48d10ab88a/users/54986a6a3c1b42759785f01e97c123c1/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.599508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e45d76a173848f7a3e5cc48d10ab88a, user_id=54986a6a3c1b42759785f01e97c123c1, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.602130 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.616012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1234/2401] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:29 2022] PUT /identity/v3/projects/1e45d76a173848f7a3e5cc48d10ab88a/users/54986a6a3c1b42759785f01e97c123c1/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:29.626420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3df3de-94c9-4272-ac5d-ba29e180e8da None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.626724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3df3de-94c9-4272-ac5d-ba29e180e8da None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.627050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3df3de-94c9-4272-ac5d-ba29e180e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.653843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ba3df3de-94c9-4272-ac5d-ba29e180e8da None None] MFA Rules not processed for user `54986a6a3c1b42759785f01e97c123c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:29.655104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ba3df3de-94c9-4272-ac5d-ba29e180e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:29.723939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1168/2402] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:29.735362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:29.737352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:29.815309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141758-90ef-4839-bc59-2adaa4515d74 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:29.820764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348c90-524a-4322-b27d-ba286e40a18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:29.821419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348c90-524a-4322-b27d-ba286e40a18f service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:29.821716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348c90-524a-4322-b27d-ba286e40a18f service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:29.822005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348c90-524a-4322-b27d-ba286e40a18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:29.829674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348c90-524a-4322-b27d-ba286e40a18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:29.831811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348c90-524a-4322-b27d-ba286e40a18f service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:29.840598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1235/2403] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:32.486784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3df3de-94c9-4272-ac5d-ba29e180e8da None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:32.546039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3df3de-94c9-4272-ac5d-ba29e180e8da None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:32.550686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:32.551594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:32.551884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:32.552170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] PATH_INFO: `/v3/users/54986a6a3c1b42759785f01e97c123c1` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:32.553338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54986a6a3c1b42759785f01e97c123c1)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:32.555281 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:32.600902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54986a6a3c1b42759785f01e97c123c1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:32.607602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54986a6a3c1b42759785f01e97c123c1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:32.610022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:32.615491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54986a6a3c1b42759785f01e97c123c1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:32.616311 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54986a6a3c1b42759785f01e97c123c1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:32.617347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54986a6a3c1b42759785f01e97c123c1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:32.635697 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1169/2404] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:32 2022] DELETE /identity/v3/users/54986a6a3c1b42759785f01e97c123c1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:32.640328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:32.640807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:32.640904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:32.657629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:32.658859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:32.717398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1236/2405] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:32.727516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:32.728947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:32.787000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce05b7c-014d-4d1c-a6b9-3e3a6f89e2b8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:32.790873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d85bcd-4ef7-4783-9699-fbb9941fdad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:32.791555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d85bcd-4ef7-4783-9699-fbb9941fdad5 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:32.791853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d85bcd-4ef7-4783-9699-fbb9941fdad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:32.792137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d85bcd-4ef7-4783-9699-fbb9941fdad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:32.801504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d85bcd-4ef7-4783-9699-fbb9941fdad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:32.802953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d85bcd-4ef7-4783-9699-fbb9941fdad5 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:32.812283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1170/2406] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:33.077228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.078743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:33.092184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355beaa-0ffe-4f18-8076-a165c4a86b60 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.097144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.098011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.098314 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.098574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] PATH_INFO: `/v3/projects/1e45d76a173848f7a3e5cc48d10ab88a` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.099790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e45d76a173848f7a3e5cc48d10ab88a)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.101691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.136434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:33.151440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e45d76a173848f7a3e5cc48d10ab88a', 'request_id': 'req-194d8dcc-77b3-4576-b830-0bd0b9068638'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:33.165817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e45d76a173848f7a3e5cc48d10ab88a', 'request_id': 'req-194d8dcc-77b3-4576-b830-0bd0b9068638'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:33.171702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e45d76a173848f7a3e5cc48d10ab88a', 'request_id': 'req-194d8dcc-77b3-4576-b830-0bd0b9068638'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:33.184246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] The token cache is being invalidate because project 1e45d76a173848f7a3e5cc48d10ab88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:33.184535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:33.185173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-194d8dcc-77b3-4576-b830-0bd0b9068638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:33.186748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1237/2407] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:33 2022] DELETE /identity/v3/projects/1e45d76a173848f7a3e5cc48d10ab88a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:33.192112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909220-c8b9-4e82-9f6e-ad4ba05f9f62 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.192411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909220-c8b9-4e82-9f6e-ad4ba05f9f62 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.192694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909220-c8b9-4e82-9f6e-ad4ba05f9f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.210196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-38909220-c8b9-4e82-9f6e-ad4ba05f9f62 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:33.211419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-38909220-c8b9-4e82-9f6e-ad4ba05f9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:33.268871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1171/2408] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:33.276286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0deb40-dcf3-4e63-8c24-8187b0359421 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.276582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0deb40-dcf3-4e63-8c24-8187b0359421 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.276868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0deb40-dcf3-4e63-8c24-8187b0359421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.294032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8e0deb40-dcf3-4e63-8c24-8187b0359421 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:33.295243 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8e0deb40-dcf3-4e63-8c24-8187b0359421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:33.302900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1238/2409] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:33.306680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38909220-c8b9-4e82-9f6e-ad4ba05f9f62 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.316633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38909220-c8b9-4e82-9f6e-ad4ba05f9f62 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.321195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.321849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.322143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.322428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.323206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:33.323509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.325106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.337086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1172/2410] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:56:33.341186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0deb40-dcf3-4e63-8c24-8187b0359421 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.350295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0deb40-dcf3-4e63-8c24-8187b0359421 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.354896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.355590 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.356056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.356341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.357048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.359004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.386751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1239/2411] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:33 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:33.391039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.400932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20229d3-8682-4e19-af0d-2e6460f0e5c8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.456625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.457305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.457594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.457876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.458666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.460631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.470181 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:33.482556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1173/2412] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:33 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:33.486424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.497286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c39e3-8f85-4593-961d-45cd41def293 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.501864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.502532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.503389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.503675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.504406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.506006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.515941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1240/2413] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:33.519893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.529448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3988c7d-0ef3-461f-b8b5-3142c35448f4 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.534050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3d55-e2b1-4310-8838-20b0f96bad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.534705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3d55-e2b1-4310-8838-20b0f96bad79 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.535032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3d55-e2b1-4310-8838-20b0f96bad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.535317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3d55-e2b1-4310-8838-20b0f96bad79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.536035 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3d55-e2b1-4310-8838-20b0f96bad79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.537621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3d55-e2b1-4310-8838-20b0f96bad79 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.547511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1174/2414] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:33.551849 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.561364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff922bb8-d225-4fd5-a607-dfbf7f15c0fe admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.566485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.567395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.567681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.567956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] PATH_INFO: `/v3/projects/86a3d7fb617942d38a255d83f8bdf1fe/users/26a6f398f65145d5b8075a1bd4457628/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.581994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a3d7fb617942d38a255d83f8bdf1fe, user_id=26a6f398f65145d5b8075a1bd4457628, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.584771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.598313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1241/2415] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:33 2022] PUT /identity/v3/projects/86a3d7fb617942d38a255d83f8bdf1fe/users/26a6f398f65145d5b8075a1bd4457628/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:33.608509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa62e-659f-4ac3-a8e7-2ad2aed37569 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.608817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa62e-659f-4ac3-a8e7-2ad2aed37569 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.609106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa62e-659f-4ac3-a8e7-2ad2aed37569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.636221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a47fa62e-659f-4ac3-a8e7-2ad2aed37569 None None] MFA Rules not processed for user `26a6f398f65145d5b8075a1bd4457628`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:33.637424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a47fa62e-659f-4ac3-a8e7-2ad2aed37569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:33.700041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1175/2416] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:33.712376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:33.713809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:33.770698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242073-f3ee-4db5-9ba0-2dcb22655a03 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:33.774418 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b08f-5e03-4000-8e92-195b01cb56d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:33.775125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b08f-5e03-4000-8e92-195b01cb56d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:33.775419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b08f-5e03-4000-8e92-195b01cb56d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:33.775707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b08f-5e03-4000-8e92-195b01cb56d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:33.784646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b08f-5e03-4000-8e92-195b01cb56d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:33.786080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b08f-5e03-4000-8e92-195b01cb56d0 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:33.795461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1242/2417] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:41.994493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fa62e-659f-4ac3-a8e7-2ad2aed37569 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:42.054944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fa62e-659f-4ac3-a8e7-2ad2aed37569 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:42.059374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:42.060246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.060533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.060814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] PATH_INFO: `/v3/users/26a6f398f65145d5b8075a1bd4457628` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.061984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a6f398f65145d5b8075a1bd4457628)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:42.063928 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:42.108469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a6f398f65145d5b8075a1bd4457628'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.115351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a6f398f65145d5b8075a1bd4457628'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.122331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a6f398f65145d5b8075a1bd4457628'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.123009 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a6f398f65145d5b8075a1bd4457628'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.123640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a6f398f65145d5b8075a1bd4457628'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.134051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:42.142821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1176/2418] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:41 2022] DELETE /identity/v3/users/26a6f398f65145d5b8075a1bd4457628 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:42.148247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.148810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.148810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.165786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:42.167010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:42.216274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:42.226219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1243/2419] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:42.235845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:42.237844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:42.293611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a5239-2e81-4945-a3ac-08721095e253 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:42.297268 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d875a-80be-4a32-8794-3d65ace9b5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:42.297912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d875a-80be-4a32-8794-3d65ace9b5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.298202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d875a-80be-4a32-8794-3d65ace9b5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.298484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d875a-80be-4a32-8794-3d65ace9b5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.308067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d875a-80be-4a32-8794-3d65ace9b5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:42.309484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d875a-80be-4a32-8794-3d65ace9b5d5 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:42.318766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1177/2420] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:42.587343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:42.589014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:42.603262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38091b-c44a-402c-9a48-0fbffb5bff7e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:42.608296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:42.609165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.609455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.609839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] PATH_INFO: `/v3/projects/86a3d7fb617942d38a255d83f8bdf1fe` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.611045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a3d7fb617942d38a255d83f8bdf1fe)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:42.612951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:42.660158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a3d7fb617942d38a255d83f8bdf1fe', 'request_id': 'req-3f353360-eaa3-4ea7-af05-027dc430e6ac'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.667592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a3d7fb617942d38a255d83f8bdf1fe', 'request_id': 'req-3f353360-eaa3-4ea7-af05-027dc430e6ac'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.673346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a3d7fb617942d38a255d83f8bdf1fe', 'request_id': 'req-3f353360-eaa3-4ea7-af05-027dc430e6ac'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.684294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] The token cache is being invalidate because project 86a3d7fb617942d38a255d83f8bdf1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:42.684584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.685211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3f353360-eaa3-4ea7-af05-027dc430e6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:42.686817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1244/2421] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:42 2022] DELETE /identity/v3/projects/86a3d7fb617942d38a255d83f8bdf1fe => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:42.691939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d14c7-42e6-451c-9366-2ebab11a5982 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.692243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d14c7-42e6-451c-9366-2ebab11a5982 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.692530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d14c7-42e6-451c-9366-2ebab11a5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.711288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e50d14c7-42e6-451c-9366-2ebab11a5982 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:42.712567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e50d14c7-42e6-451c-9366-2ebab11a5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:42.784352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1178/2422] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:42.792099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8c46-e4c5-430c-b2c9-21f34df148c4 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.792398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8c46-e4c5-430c-b2c9-21f34df148c4 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.792685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8c46-e4c5-430c-b2c9-21f34df148c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.810599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-25cc8c46-e4c5-430c-b2c9-21f34df148c4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:42.811839 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-25cc8c46-e4c5-430c-b2c9-21f34df148c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:42.820163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1245/2423] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:42.824360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d14c7-42e6-451c-9366-2ebab11a5982 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:42.834580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d14c7-42e6-451c-9366-2ebab11a5982 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:42.839047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:42.839700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.839988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.840272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.840994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:42.841302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:42.842892 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:42.854109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1179/2424] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:56:42.858127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc8c46-e4c5-430c-b2c9-21f34df148c4 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:42.867252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc8c46-e4c5-430c-b2c9-21f34df148c4 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:42.871800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:42.872428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.872713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.872988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.873670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:42.875597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:42.901099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1246/2425] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:42 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:42.905187 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:42.915379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db0df3-17bb-4cbe-9179-e6618834d1ac admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:42.970308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:42.971001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:42.971294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:42.971579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:42.972273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:42.974180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:42.995941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1180/2426] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:42 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:42.998364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:43.008936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a7f87-daab-47c4-98ee-0e73ce4a5b1f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:43.013442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:43.014102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.014390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.014669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.015441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:43.017027 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:43.027955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1247/2427] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:43.032171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:43.042814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc889b4f-c7ed-4983-ad53-b0311cd43079 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:43.047382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97101bf4-4087-42f5-abb4-449b7a2e2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:43.048047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101bf4-4087-42f5-abb4-449b7a2e2953 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.048340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101bf4-4087-42f5-abb4-449b7a2e2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.048633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101bf4-4087-42f5-abb4-449b7a2e2953 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.049365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97101bf4-4087-42f5-abb4-449b7a2e2953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:43.050983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97101bf4-4087-42f5-abb4-449b7a2e2953 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:43.060686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1181/2428] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:43.064775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:43.075179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfead40a-da8d-4a1b-ae4b-05cc9248f7d5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:43.079777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:43.080670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.081572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.081879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] PATH_INFO: `/v3/projects/b403f9e062a547829419c89262f227b9/users/0097f901264842bf971ff6d6e7d31b7c/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.096820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b403f9e062a547829419c89262f227b9, user_id=0097f901264842bf971ff6d6e7d31b7c, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:43.099736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:43.115877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1248/2429] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:43 2022] PUT /identity/v3/projects/b403f9e062a547829419c89262f227b9/users/0097f901264842bf971ff6d6e7d31b7c/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:43.126166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b06e7-7dd8-4394-ba2c-3b96c6eacf55 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.126462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b06e7-7dd8-4394-ba2c-3b96c6eacf55 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.126749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b06e7-7dd8-4394-ba2c-3b96c6eacf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.133204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:43.155579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-eb3b06e7-7dd8-4394-ba2c-3b96c6eacf55 None None] MFA Rules not processed for user `0097f901264842bf971ff6d6e7d31b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:43.156795 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-eb3b06e7-7dd8-4394-ba2c-3b96c6eacf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:43.220063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1182/2430] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:43.230987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:43.232676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:43.305529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fcded-48fa-4928-8462-985e648c20af admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:43.310997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639f0eb-e5e8-4c24-a2c6-c91bfcb4e8c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:43.311648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f0eb-e5e8-4c24-a2c6-c91bfcb4e8c8 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.311943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f0eb-e5e8-4c24-a2c6-c91bfcb4e8c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.312228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f0eb-e5e8-4c24-a2c6-c91bfcb4e8c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.320522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639f0eb-e5e8-4c24-a2c6-c91bfcb4e8c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:43.322106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639f0eb-e5e8-4c24-a2c6-c91bfcb4e8c8 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:43.330987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1249/2431] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:43.533613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b06e7-7dd8-4394-ba2c-3b96c6eacf55 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:43.595861 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b06e7-7dd8-4394-ba2c-3b96c6eacf55 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:43.600814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:43.601696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.601988 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.602274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] PATH_INFO: `/v3/users/0097f901264842bf971ff6d6e7d31b7c` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.603504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0097f901264842bf971ff6d6e7d31b7c)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:43.605429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:43.651555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0097f901264842bf971ff6d6e7d31b7c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:43.658415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0097f901264842bf971ff6d6e7d31b7c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:43.666273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0097f901264842bf971ff6d6e7d31b7c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:43.667079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0097f901264842bf971ff6d6e7d31b7c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:43.667709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0097f901264842bf971ff6d6e7d31b7c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:43.685388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1183/2432] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:43 2022] DELETE /identity/v3/users/0097f901264842bf971ff6d6e7d31b7c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:43.689974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.690298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.690585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.697234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:43.709262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:43.710515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:43.776709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1250/2433] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:43.786850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:43.788270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:43.802424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:43.847534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b9e2b-a0c9-42ca-b9fd-52e7574683c0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:43.851135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1cec6-c02e-43f9-9552-2dc7126180b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:43.851785 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cec6-c02e-43f9-9552-2dc7126180b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:43.852074 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cec6-c02e-43f9-9552-2dc7126180b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:43.852356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cec6-c02e-43f9-9552-2dc7126180b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:43.861301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1cec6-c02e-43f9-9552-2dc7126180b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:43.862725 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1cec6-c02e-43f9-9552-2dc7126180b8 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:43.872130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1184/2434] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:44.137583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.139091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:44.151666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02ef14-e8a6-47e7-a82f-b27fc94651d9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.156297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.157176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.157467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.157749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] PATH_INFO: `/v3/projects/b403f9e062a547829419c89262f227b9` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.159615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b403f9e062a547829419c89262f227b9)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.161534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.209626 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b403f9e062a547829419c89262f227b9', 'request_id': 'req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:44.216952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b403f9e062a547829419c89262f227b9', 'request_id': 'req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:44.223249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b403f9e062a547829419c89262f227b9', 'request_id': 'req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:44.234367 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] The token cache is being invalidate because project b403f9e062a547829419c89262f227b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:44.234989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:44.235327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-601d0b75-9f7f-4dc5-baec-1cb4e5bcd0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:44.236880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1251/2435] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:44 2022] DELETE /identity/v3/projects/b403f9e062a547829419c89262f227b9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:44.241908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff471-2555-46c3-ab8f-0e5d0f99cd05 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.242335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff471-2555-46c3-ab8f-0e5d0f99cd05 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.242476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff471-2555-46c3-ab8f-0e5d0f99cd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.260000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3b2ff471-2555-46c3-ab8f-0e5d0f99cd05 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:44.261180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3b2ff471-2555-46c3-ab8f-0e5d0f99cd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:44.319833 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1185/2436] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:44.329013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4eeb-6e90-4396-9e15-1359006b08cc None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.329311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4eeb-6e90-4396-9e15-1359006b08cc None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.329600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4eeb-6e90-4396-9e15-1359006b08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.348512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3b9e4eeb-6e90-4396-9e15-1359006b08cc None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:44.349708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3b9e4eeb-6e90-4396-9e15-1359006b08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:44.357681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1252/2437] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:44.361740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ff471-2555-46c3-ab8f-0e5d0f99cd05 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.371309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ff471-2555-46c3-ab8f-0e5d0f99cd05 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.375751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.376401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.376691 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.376969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.378180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:44.378490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.380113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.391416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1186/2438] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:56:44.395994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e4eeb-6e90-4396-9e15-1359006b08cc None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.404972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e4eeb-6e90-4396-9e15-1359006b08cc None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.409683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.410327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.410640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.410936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.411632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.413515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.438081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1253/2439] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:44 2022] POST /identity/v3/projects => generated 403 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:44.442713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.452590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b356b-173b-43b6-bdf3-1ea77f322099 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.507355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.508030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.508315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.508676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.509378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.511318 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.531060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1187/2440] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:44 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:44.535038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.545295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e220cb-24a2-4ae4-9a4b-0e1092270aa0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.549790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.550441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.550727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.551039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.551761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.553342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.563409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1254/2441] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:44.567663 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.577456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6cc2f-853f-4a7e-a924-8c96cacbcb22 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.582747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1f4dc-1dc2-4b6a-af70-2451505614a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.583442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1f4dc-1dc2-4b6a-af70-2451505614a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.583736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1f4dc-1dc2-4b6a-af70-2451505614a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.584020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1f4dc-1dc2-4b6a-af70-2451505614a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.584746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1f4dc-1dc2-4b6a-af70-2451505614a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.586424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1f4dc-1dc2-4b6a-af70-2451505614a2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.596648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1188/2442] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:44.600599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.610377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894eb80-4949-4620-9047-8a9b7528174e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.615435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.616307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.616595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.616874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] PATH_INFO: `/v3/projects/1d8a86f701ea459784073a4f94bc764a/users/22d09b16a4dc4e1c954a8d1f7c7fe05d/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.631178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8a86f701ea459784073a4f94bc764a, user_id=22d09b16a4dc4e1c954a8d1f7c7fe05d, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.633913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.647472 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1255/2443] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:44 2022] PUT /identity/v3/projects/1d8a86f701ea459784073a4f94bc764a/users/22d09b16a4dc4e1c954a8d1f7c7fe05d/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:44.657565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1847-36aa-4ac4-b5c5-0af307123fa3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.657870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1847-36aa-4ac4-b5c5-0af307123fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.658165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1847-36aa-4ac4-b5c5-0af307123fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.684912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b18a1847-36aa-4ac4-b5c5-0af307123fa3 None None] MFA Rules not processed for user `22d09b16a4dc4e1c954a8d1f7c7fe05d`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:44.686156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b18a1847-36aa-4ac4-b5c5-0af307123fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:44.694792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:44.752183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1189/2444] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:44.757280 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.783578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:44.820010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871bc0-e985-48c1-b618-139bc01fcadd admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.824655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.825320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.825611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.825895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.826596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.828558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.852321 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1256/2445] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:44 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:44.856439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a1847-36aa-4ac4-b5c5-0af307123fa3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.867360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a1847-36aa-4ac4-b5c5-0af307123fa3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.922134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.922741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.923062 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.923346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.924029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.926439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.945569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1190/2446] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:44 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:44.949515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.959762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279250fa-0ea8-46a8-a1ff-2b6de9bba957 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.964519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.965185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.965473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.965780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:44.966504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:44.968168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:44.979179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1257/2447] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:44.982983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:44.993146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144ab50-75f8-4e65-a8ec-c85df71d97f6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:44.997654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:44.998524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:44.998813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:44.999193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] PATH_INFO: `/v3/projects/1fb4229fa6494a249f75093b9443205d/users/f7b3d6f329354c45955e9af951a170fb/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.013579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb4229fa6494a249f75093b9443205d, user_id=f7b3d6f329354c45955e9af951a170fb, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:45.016250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:45.029294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1191/2448] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:44 2022] PUT /identity/v3/projects/1fb4229fa6494a249f75093b9443205d/users/f7b3d6f329354c45955e9af951a170fb/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:45.033126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:45.043973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d7e2d-523f-469a-a978-7dd6263682f7 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:45.103812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5158e4-20b1-4974-ba7e-af5d664015a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:45.104514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5158e4-20b1-4974-ba7e-af5d664015a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:45.104804 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5158e4-20b1-4974-ba7e-af5d664015a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:45.105086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5158e4-20b1-4974-ba7e-af5d664015a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.105864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5158e4-20b1-4974-ba7e-af5d664015a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:45.107534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5158e4-20b1-4974-ba7e-af5d664015a8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:45.117926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1258/2449] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:45.122020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:45.132215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efaf0-b5e5-4850-bf80-19046ae11d51 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:45.136751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:45.137632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:45.137916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:45.138194 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] PATH_INFO: `/v3/projects/1fb4229fa6494a249f75093b9443205d/users/f7b3d6f329354c45955e9af951a170fb/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.140145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb4229fa6494a249f75093b9443205d, user_id=f7b3d6f329354c45955e9af951a170fb, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:45.142761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:45.152728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1192/2450] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:45 2022] PUT /identity/v3/projects/1fb4229fa6494a249f75093b9443205d/users/f7b3d6f329354c45955e9af951a170fb/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:45.163171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0380b-46ef-448a-89cb-a3523e38fd48 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:45.163546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0380b-46ef-448a-89cb-a3523e38fd48 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:45.163833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0380b-46ef-448a-89cb-a3523e38fd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.190274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-79e0380b-46ef-448a-89cb-a3523e38fd48 None None] MFA Rules not processed for user `f7b3d6f329354c45955e9af951a170fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:45.191467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-79e0380b-46ef-448a-89cb-a3523e38fd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:45.257189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1259/2451] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:45.267582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:45.269412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:45.326174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ba6f-2507-43e0-8059-dec5f392ebd1 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:45.329872 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141abf2d-68fc-460c-a4db-1044fb79e627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:45.330546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141abf2d-68fc-460c-a4db-1044fb79e627 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:45.331377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141abf2d-68fc-460c-a4db-1044fb79e627 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:45.331684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141abf2d-68fc-460c-a4db-1044fb79e627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.340932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141abf2d-68fc-460c-a4db-1044fb79e627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:45.342349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141abf2d-68fc-460c-a4db-1044fb79e627 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:45.352452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1193/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:45.488627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0380b-46ef-448a-89cb-a3523e38fd48 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:45.509534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:45.550932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0380b-46ef-448a-89cb-a3523e38fd48 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:45.555446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:45.556326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:45.556615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:45.556898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] PATH_INFO: `/v3/users/22d09b16a4dc4e1c954a8d1f7c7fe05d` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.558078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d09b16a4dc4e1c954a8d1f7c7fe05d)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:45.560045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:45.605252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d09b16a4dc4e1c954a8d1f7c7fe05d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:45.613109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d09b16a4dc4e1c954a8d1f7c7fe05d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:45.613775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d09b16a4dc4e1c954a8d1f7c7fe05d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:45.621082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d09b16a4dc4e1c954a8d1f7c7fe05d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:45.633257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d09b16a4dc4e1c954a8d1f7c7fe05d'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:45.639141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1260/2453] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:45 2022] DELETE /identity/v3/users/22d09b16a4dc4e1c954a8d1f7c7fe05d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:45.643687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:45.644013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:45.644295 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.650885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:45.662654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:45.663895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:45.722689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1194/2454] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:45.732284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:45.733696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:45.790473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4235f9e-8c30-4770-a505-cf845257154c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:45.794106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:45.794756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:45.795086 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:45.795369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:45.804327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:45.805770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:45.815812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1261/2455] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:46.083857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:46.085291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:46.097203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b280-291a-4425-a0e6-0f9e7bbe2afa None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:46.102675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:46.104015 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.104438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.104824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] PATH_INFO: `/v3/projects/1d8a86f701ea459784073a4f94bc764a` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.106024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8a86f701ea459784073a4f94bc764a)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:46.109072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:46.158231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8a86f701ea459784073a4f94bc764a', 'request_id': 'req-e58af515-9d41-4330-8540-c8400983d358'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.164808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8a86f701ea459784073a4f94bc764a', 'request_id': 'req-e58af515-9d41-4330-8540-c8400983d358'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.170749 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8a86f701ea459784073a4f94bc764a', 'request_id': 'req-e58af515-9d41-4330-8540-c8400983d358'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.181917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] The token cache is being invalidate because project 1d8a86f701ea459784073a4f94bc764a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:46.182204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.182826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.184377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1195/2456] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:46 2022] DELETE /identity/v3/projects/1d8a86f701ea459784073a4f94bc764a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:46.188397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:46.198677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a030-9913-45fb-a16c-532e8830daa7 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:46.238944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:46.257424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:46.258300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.258587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.258864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] PATH_INFO: `/v3/users/f7b3d6f329354c45955e9af951a170fb` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.260061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b3d6f329354c45955e9af951a170fb)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:46.261968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:46.308386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b3d6f329354c45955e9af951a170fb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.315907 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b3d6f329354c45955e9af951a170fb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.316530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b3d6f329354c45955e9af951a170fb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.323335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b3d6f329354c45955e9af951a170fb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.335097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-b217ee32-dc14-4f89-bd07-21f7c9307672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b3d6f329354c45955e9af951a170fb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.341101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1262/2457] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:46 2022] DELETE /identity/v3/users/f7b3d6f329354c45955e9af951a170fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:46.606624 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:46.608146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:46.624486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58af515-9d41-4330-8540-c8400983d358 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:46.680282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:46.681148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.681433 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.681714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] PATH_INFO: `/v3/projects/1fb4229fa6494a249f75093b9443205d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.682873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb4229fa6494a249f75093b9443205d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:46.684805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:46.717939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:46.732240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb4229fa6494a249f75093b9443205d', 'request_id': 'req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.740454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb4229fa6494a249f75093b9443205d', 'request_id': 'req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.745935 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb4229fa6494a249f75093b9443205d', 'request_id': 'req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.756813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] The token cache is being invalidate because project 1fb4229fa6494a249f75093b9443205d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:46.757101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.757733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:46.759296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1196/2458] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:46 2022] DELETE /identity/v3/projects/1fb4229fa6494a249f75093b9443205d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:46.765002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569666f5-e816-49e4-8c12-bad800a71f8b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.765302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569666f5-e816-49e4-8c12-bad800a71f8b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.765587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569666f5-e816-49e4-8c12-bad800a71f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.775771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:46.777207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:46.784596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-569666f5-e816-49e4-8c12-bad800a71f8b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:46.785782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-569666f5-e816-49e4-8c12-bad800a71f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:46.835895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a5b9c-cead-47d5-af1d-94c4d3e4e8eb admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:46.839494 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:46.840145 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.840436 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.840717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.842464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:46.847000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1263/2459] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:46.855894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18371f-cfe0-4cd1-8828-36b0beb64070 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.856197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18371f-cfe0-4cd1-8828-36b0beb64070 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.857195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18371f-cfe0-4cd1-8828-36b0beb64070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.875036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6a18371f-cfe0-4cd1-8828-36b0beb64070 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:46.876159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6a18371f-cfe0-4cd1-8828-36b0beb64070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:46.885119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1264/2460] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:46.889014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18371f-cfe0-4cd1-8828-36b0beb64070 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:46.897986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18371f-cfe0-4cd1-8828-36b0beb64070 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:46.903416 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:46.904069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.904364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.904650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.905375 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:46.905689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:46.907318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:46.919246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1265/2461] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:56:46.923391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:46.929660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:46.931342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:46.933374 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32361b-846f-43b4-b756-e35989de6925 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:46.938048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:46.938679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:46.938994 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:46.939281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:46.939962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:46.942393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:46.950226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1197/2462] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:56:46.971044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1266/2463] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:46 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:46.975654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:46.986731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7c7c-5c01-4889-8561-d108920ec72d service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.029750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:47.047641 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.048225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.048514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.048796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.050171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.052195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.075532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1198/2464] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:46 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:47.079425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.090068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4297c7-7184-43d2-8b54-8148f678047f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.095903 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.096643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.096942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.097232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.097982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.099631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.110773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1267/2465] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:56:47.114952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.126536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c01187-54e7-4809-ab66-85ec863b79e8 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.131801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42a97d-7220-458a-b03b-6036d3e55d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.132471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a97d-7220-458a-b03b-6036d3e55d13 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.132761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a97d-7220-458a-b03b-6036d3e55d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.133043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a97d-7220-458a-b03b-6036d3e55d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.133773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42a97d-7220-458a-b03b-6036d3e55d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.135985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42a97d-7220-458a-b03b-6036d3e55d13 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.146651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1199/2466] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:56:47.150663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.160891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f5580-9afe-4e56-8a09-ddb07e2c9f72 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.166151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.167173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.167547 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.167892 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] PATH_INFO: `/v3/projects/8d412852f5f043d08b1bcff5e45c272f/users/e40b0415f12e46c9af04bfc2929950d8/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.171749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:47.186909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d412852f5f043d08b1bcff5e45c272f, user_id=e40b0415f12e46c9af04bfc2929950d8, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.190788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.218481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1268/2467] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:47 2022] PUT /identity/v3/projects/8d412852f5f043d08b1bcff5e45c272f/users/e40b0415f12e46c9af04bfc2929950d8/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:47.220347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13842c-21d2-4654-9b22-4792eab47f2f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.221125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13842c-21d2-4654-9b22-4792eab47f2f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.222611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13842c-21d2-4654-9b22-4792eab47f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.264099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1b13842c-21d2-4654-9b22-4792eab47f2f None None] MFA Rules not processed for user `e40b0415f12e46c9af04bfc2929950d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:47.265561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1b13842c-21d2-4654-9b22-4792eab47f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:47.341940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1200/2468] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:47.345992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.435316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6324f1-ce0d-47c7-8046-a845b8967df4 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.440227 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.440894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.441187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.441473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.442165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.444128 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.482119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1269/2469] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:47.486075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13842c-21d2-4654-9b22-4792eab47f2f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.500842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13842c-21d2-4654-9b22-4792eab47f2f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.561896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.562585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.562877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.563195 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.563897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.565854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.587051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1201/2470] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:47 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:47.591387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.602256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268963-946f-4445-9179-059c1e3a3c03 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.606896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.607584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.607875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.608171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.608884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.610483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.621069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1270/2471] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:47.625177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.635325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6580dd5-6d18-44c6-b378-21cdb628751f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.640050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.640962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.641262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.641542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] PATH_INFO: `/v3/projects/0b3a8e4e86904dc691c46783ab76f497/users/d75231db5f7749c4a613df368fcf942b/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.656525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3a8e4e86904dc691c46783ab76f497, user_id=d75231db5f7749c4a613df368fcf942b, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.659922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.672747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1202/2472] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:47 2022] PUT /identity/v3/projects/0b3a8e4e86904dc691c46783ab76f497/users/d75231db5f7749c4a613df368fcf942b/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:47.676800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.686656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47bd2-409a-4a38-9627-30238bdffa73 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.743362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417935a-0064-40ad-88a4-86abd9206604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.744073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417935a-0064-40ad-88a4-86abd9206604 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.744480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417935a-0064-40ad-88a4-86abd9206604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.744767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417935a-0064-40ad-88a4-86abd9206604 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.745495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417935a-0064-40ad-88a4-86abd9206604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.747154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417935a-0064-40ad-88a4-86abd9206604 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.756780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1271/2473] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:47.761408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.774058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ef6e-cfa5-4d9a-ae5c-e2c826eb81a2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.783873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.785437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.785730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.786018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] PATH_INFO: `/v3/projects/0b3a8e4e86904dc691c46783ab76f497/users/d75231db5f7749c4a613df368fcf942b/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.788063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3a8e4e86904dc691c46783ab76f497, user_id=d75231db5f7749c4a613df368fcf942b, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.791050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.801635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1203/2474] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:47 2022] PUT /identity/v3/projects/0b3a8e4e86904dc691c46783ab76f497/users/d75231db5f7749c4a613df368fcf942b/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:47.812001 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039359c-82b3-4f23-9449-ecfb6327812f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.812304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039359c-82b3-4f23-9449-ecfb6327812f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.812593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039359c-82b3-4f23-9449-ecfb6327812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.838541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-7039359c-82b3-4f23-9449-ecfb6327812f None None] MFA Rules not processed for user `d75231db5f7749c4a613df368fcf942b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:47.839754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7039359c-82b3-4f23-9449-ecfb6327812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:47.881589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:47.906139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1272/2475] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:47.918520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:47.924097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:47.974550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2574c-8712-4328-a0cb-7e176bb2543c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:47.978159 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736f2a3-7ddf-43a5-9848-5e868601a67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:47.978805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f2a3-7ddf-43a5-9848-5e868601a67d service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:47.979124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f2a3-7ddf-43a5-9848-5e868601a67d service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:47.979407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f2a3-7ddf-43a5-9848-5e868601a67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:47.988227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736f2a3-7ddf-43a5-9848-5e868601a67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:47.989648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736f2a3-7ddf-43a5-9848-5e868601a67d service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:47.998965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1204/2476] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:48.059997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039359c-82b3-4f23-9449-ecfb6327812f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:48.139461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039359c-82b3-4f23-9449-ecfb6327812f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:48.146299 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:48.147716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:48.148139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:48.148445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] PATH_INFO: `/v3/users/e40b0415f12e46c9af04bfc2929950d8` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:48.149657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40b0415f12e46c9af04bfc2929950d8)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:48.151614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:48.199050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40b0415f12e46c9af04bfc2929950d8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.207025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40b0415f12e46c9af04bfc2929950d8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.207655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40b0415f12e46c9af04bfc2929950d8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.214674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40b0415f12e46c9af04bfc2929950d8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.226494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40b0415f12e46c9af04bfc2929950d8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.232285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1273/2477] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:48 2022] DELETE /identity/v3/users/e40b0415f12e46c9af04bfc2929950d8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:48.236901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:48.237230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:48.237519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:48.256382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:48.257589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:48.319273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1205/2478] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:48.328806 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:48.330199 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:48.387475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226107-d432-4f8c-9152-ec99a5b34c7f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:48.391102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:48.391742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:48.392031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:48.392311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:48.401117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:48.402538 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:48.411985 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1274/2479] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:48.704048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:48.705774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:48.722408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866e4c1-821a-47a6-b7cf-c937648ed097 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:48.728042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:48.729150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:48.729404 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:48.729684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] PATH_INFO: `/v3/projects/8d412852f5f043d08b1bcff5e45c272f` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:48.731018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d412852f5f043d08b1bcff5e45c272f)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:48.733007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:48.783098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d412852f5f043d08b1bcff5e45c272f', 'request_id': 'req-3974f155-a9c0-4850-8d5d-11568e8d8534'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.791088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d412852f5f043d08b1bcff5e45c272f', 'request_id': 'req-3974f155-a9c0-4850-8d5d-11568e8d8534'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.796657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d412852f5f043d08b1bcff5e45c272f', 'request_id': 'req-3974f155-a9c0-4850-8d5d-11568e8d8534'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.808871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] The token cache is being invalidate because project 8d412852f5f043d08b1bcff5e45c272f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:48.809176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.809830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.811424 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1206/2480] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:48 2022] DELETE /identity/v3/projects/8d412852f5f043d08b1bcff5e45c272f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:48.815425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:48.820198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:48.826978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6cee6-7d8b-495e-a706-25bfd3aa46b5 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:48.883752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:48.884631 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:48.884917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:48.885197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] PATH_INFO: `/v3/users/d75231db5f7749c4a613df368fcf942b` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:48.886368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75231db5f7749c4a613df368fcf942b)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:48.888316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:48.938434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75231db5f7749c4a613df368fcf942b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.947878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75231db5f7749c4a613df368fcf942b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.948737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75231db5f7749c4a613df368fcf942b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.958313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75231db5f7749c4a613df368fcf942b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.973790 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d385161d-fd1b-4b25-afae-7f669fbded96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75231db5f7749c4a613df368fcf942b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:48.980655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1275/2481] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:48 2022] DELETE /identity/v3/users/d75231db5f7749c4a613df368fcf942b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:49.283007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:49.285429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:49.300284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f155-a9c0-4850-8d5d-11568e8d8534 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:49.342091 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:49.373574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:49.374450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.374746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.375067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] PATH_INFO: `/v3/projects/0b3a8e4e86904dc691c46783ab76f497` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.376283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3a8e4e86904dc691c46783ab76f497)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:49.378267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:49.425862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3a8e4e86904dc691c46783ab76f497', 'request_id': 'req-5eab3091-2aa2-4844-8d56-379f8f67f77e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:49.433437 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3a8e4e86904dc691c46783ab76f497', 'request_id': 'req-5eab3091-2aa2-4844-8d56-379f8f67f77e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:49.444039 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3a8e4e86904dc691c46783ab76f497', 'request_id': 'req-5eab3091-2aa2-4844-8d56-379f8f67f77e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:49.454604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] The token cache is being invalidate because project 0b3a8e4e86904dc691c46783ab76f497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:49.454894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:49.455569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5eab3091-2aa2-4844-8d56-379f8f67f77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:49.457638 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1207/2482] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:49 2022] DELETE /identity/v3/projects/0b3a8e4e86904dc691c46783ab76f497 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:49.462483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517422b8-8cdf-401f-838c-70e39c07689c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.462993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517422b8-8cdf-401f-838c-70e39c07689c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.463091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517422b8-8cdf-401f-838c-70e39c07689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.481695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-517422b8-8cdf-401f-838c-70e39c07689c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:49.482816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-517422b8-8cdf-401f-838c-70e39c07689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:49.546611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1276/2483] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:49.555694 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50ba2-03cd-41bc-a6ff-3f71205cc6f0 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.555993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50ba2-03cd-41bc-a6ff-3f71205cc6f0 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.556283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50ba2-03cd-41bc-a6ff-3f71205cc6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.578388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e4f50ba2-03cd-41bc-a6ff-3f71205cc6f0 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:49.580064 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e4f50ba2-03cd-41bc-a6ff-3f71205cc6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:49.591467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1208/2484] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:49.596019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517422b8-8cdf-401f-838c-70e39c07689c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:49.607295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517422b8-8cdf-401f-838c-70e39c07689c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:49.614343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:49.615547 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.615865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.616188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.617069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:49.617442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:49.619253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:49.636191 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1277/2485] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:56:49.638093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f50ba2-03cd-41bc-a6ff-3f71205cc6f0 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:49.650430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f50ba2-03cd-41bc-a6ff-3f71205cc6f0 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:49.657028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:49.657625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.657922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.658204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.659030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:49.660949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:49.691322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1209/2486] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:49.695616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:49.707650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd2d91-572b-4234-84f8-5e2cd629339b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:49.717636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:49.786267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:49.786976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.787272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.787560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.788257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:49.790196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:49.813432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1278/2487] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:49 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:49.814714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:49.826209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040fc91-498d-49b9-95b9-1c1ea2678253 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:49.831575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:49.832469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.832762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.833043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.833774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:49.835485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:49.846460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1210/2488] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:56:49.850359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:49.860361 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22718c6-92c1-4c02-99b9-3a927ff571b9 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:49.865463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd968-5465-4228-8057-189e53b35fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:49.866129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd968-5465-4228-8057-189e53b35fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.866456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd968-5465-4228-8057-189e53b35fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.866701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd968-5465-4228-8057-189e53b35fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.867465 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd968-5465-4228-8057-189e53b35fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:49.869060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd968-5465-4228-8057-189e53b35fc6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:49.879356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1279/2489] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:49.883444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:49.894204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0965-ba6e-4b44-904f-e772f2502f0a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:49.899067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:49.899968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.900262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.900554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] PATH_INFO: `/v3/projects/f751b1f880a24580bb782c96db3a754f/users/a0076c50aa3a4170a66333843972fca8/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.915255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f751b1f880a24580bb782c96db3a754f, user_id=a0076c50aa3a4170a66333843972fca8, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:49.918163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:49.931593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1211/2490] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:49 2022] PUT /identity/v3/projects/f751b1f880a24580bb782c96db3a754f/users/a0076c50aa3a4170a66333843972fca8/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:49.944420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bb2f-93ed-4cd6-b968-7f676f66fdf0 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:49.944731 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bb2f-93ed-4cd6-b968-7f676f66fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:49.945025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bb2f-93ed-4cd6-b968-7f676f66fdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:49.975038 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a1c1bb2f-93ed-4cd6-b968-7f676f66fdf0 None None] MFA Rules not processed for user `a0076c50aa3a4170a66333843972fca8`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:49.976350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a1c1bb2f-93ed-4cd6-b968-7f676f66fdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:50.073838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.075051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1280/2491] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:50.202045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:50.207216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c775843-5b75-4304-b9e3-a0c7a885e029 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.214260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.214845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.215683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.216163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.217137 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.219462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.249826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1212/2492] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:50 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:50.254306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1bb2f-93ed-4cd6-b968-7f676f66fdf0 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.264889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1bb2f-93ed-4cd6-b968-7f676f66fdf0 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.321930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.322611 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.322898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.323206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.323904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.325827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.350860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1281/2493] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:50 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:50.352170 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.362474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8b9f6-3ab1-45ee-b45c-a64fd8a9bbef admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.367045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.367707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.367993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.368272 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.368998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.370586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.381664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1213/2494] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:50.385801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.396356 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cc0b8-b089-43ac-9d8a-98ddf452c48c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.400953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8709cd-8f82-49b0-b726-5e5c6381c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.401616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8709cd-8f82-49b0-b726-5e5c6381c6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.401904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8709cd-8f82-49b0-b726-5e5c6381c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.402185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8709cd-8f82-49b0-b726-5e5c6381c6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.402972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8709cd-8f82-49b0-b726-5e5c6381c6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.404580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8709cd-8f82-49b0-b726-5e5c6381c6a7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.405932 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:50.418953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1282/2495] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:50.420554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.433913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ee33f-e6da-4fdf-b086-8608f5746b48 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.441003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.442046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.442338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.442616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] PATH_INFO: `/v3/projects/7a4451d8d4c14d1eaf5f135d80637952/users/b8ffe9d491444041864fdf69db85228e/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.459293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4451d8d4c14d1eaf5f135d80637952, user_id=b8ffe9d491444041864fdf69db85228e, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.462154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.479135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1214/2496] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:50 2022] PUT /identity/v3/projects/7a4451d8d4c14d1eaf5f135d80637952/users/b8ffe9d491444041864fdf69db85228e/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:50.490462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d9ed6-8dcb-4a16-be96-b64bc475b729 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.491055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d9ed6-8dcb-4a16-be96-b64bc475b729 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.491252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d9ed6-8dcb-4a16-be96-b64bc475b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.523121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3b4d9ed6-8dcb-4a16-be96-b64bc475b729 None None] MFA Rules not processed for user `b8ffe9d491444041864fdf69db85228e`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:50.524453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3b4d9ed6-8dcb-4a16-be96-b64bc475b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:50.609132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1283/2497] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:50.614078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.677302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffe6d-cd09-47fa-bd06-8753f514536f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.681319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.682004 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.682296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.682583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.683338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.685274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.716337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1215/2498] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:50 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:50.720635 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d9ed6-8dcb-4a16-be96-b64bc475b729 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.731911 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d9ed6-8dcb-4a16-be96-b64bc475b729 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.795782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.796607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.796971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.797320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.798097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.800684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.829245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1284/2499] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:50 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:50.830556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.842266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7bb8d-7230-4328-be44-d36d5d334c13 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.847665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.848451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.848845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.849239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.850063 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.852046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.865516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1216/2500] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:50.869318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.881455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b6036-26ed-4171-9647-cd6c0620ee1b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:50.886439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:50.887569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:50.887859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:50.888139 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] PATH_INFO: `/v3/projects/c665a84780aa441ea45803c55445e910/users/b6c396bcf4e14abc8ec44b5ac463dac7/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:50.906318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c665a84780aa441ea45803c55445e910, user_id=b6c396bcf4e14abc8ec44b5ac463dac7, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:50.909559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:50.930902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1285/2501] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:50 2022] PUT /identity/v3/projects/c665a84780aa441ea45803c55445e910/users/b6c396bcf4e14abc8ec44b5ac463dac7/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:50.932696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:50.943317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db109-1b67-4ad0-a22a-0b753869da08 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:51.016251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f8627-8891-4ea5-9f62-089dc65f91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:51.016943 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8627-8891-4ea5-9f62-089dc65f91ef admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:51.017236 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8627-8891-4ea5-9f62-089dc65f91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:51.017519 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8627-8891-4ea5-9f62-089dc65f91ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:51.018308 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f8627-8891-4ea5-9f62-089dc65f91ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:51.019985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f8627-8891-4ea5-9f62-089dc65f91ef admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:51.030824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1217/2502] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:51.035596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:51.047926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c09e10-8629-4b3d-8b7d-b9d35092a7c4 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:51.053524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:51.054721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:51.055158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:51.055521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] PATH_INFO: `/v3/projects/c665a84780aa441ea45803c55445e910/users/b6c396bcf4e14abc8ec44b5ac463dac7/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:51.057679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c665a84780aa441ea45803c55445e910, user_id=b6c396bcf4e14abc8ec44b5ac463dac7, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:51.060987 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:51.078969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1286/2503] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:51 2022] PUT /identity/v3/projects/c665a84780aa441ea45803c55445e910/users/b6c396bcf4e14abc8ec44b5ac463dac7/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:51.088387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:51.088684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:51.088969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:51.121003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] MFA Rules not processed for user `b6c396bcf4e14abc8ec44b5ac463dac7`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:51.122296 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:51.128609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:51.201026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1218/2504] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:51.209851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:51.211910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:51.260782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:51.277850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb261d-fd86-48bd-b8cc-f564b8735f7a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:51.281592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:51.282271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:51.282568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:51.282855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:51.293751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:51.295270 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:51.306589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1287/2505] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:51.351498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:51.352910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:51.365083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5586d9-41be-41c0-868b-c46584dbc2cb None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:51.368768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:51.369368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:51.369654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:51.369932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:51.431960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:51.433443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:51.443133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1219/2506] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:54.152030 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:54.153439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:54.211763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9647b-f3aa-44ad-9f0c-88b2ca10613c service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:54.215305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb870b3-54fc-4a86-b59b-21b5a4a8ff56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:54.215949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb870b3-54fc-4a86-b59b-21b5a4a8ff56 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:54.216238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb870b3-54fc-4a86-b59b-21b5a4a8ff56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:54.216517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb870b3-54fc-4a86-b59b-21b5a4a8ff56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:54.218252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-adb870b3-54fc-4a86-b59b-21b5a4a8ff56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:54.282532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb870b3-54fc-4a86-b59b-21b5a4a8ff56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:54.284513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb870b3-54fc-4a86-b59b-21b5a4a8ff56 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:54.294713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1288/2507] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:54.341973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:54.354772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797e847-3856-4d76-bd1c-2d519013459e service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:54.361327 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:54.362450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:54.362741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:54.363051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] PATH_INFO: `/v3/users/a0076c50aa3a4170a66333843972fca8` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:54.364312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0076c50aa3a4170a66333843972fca8)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:54.366358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:54.427104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0076c50aa3a4170a66333843972fca8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:54.434755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0076c50aa3a4170a66333843972fca8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:54.445206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0076c50aa3a4170a66333843972fca8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:54.446055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0076c50aa3a4170a66333843972fca8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:54.447054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0076c50aa3a4170a66333843972fca8'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:54.469674 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1220/2508] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:54 2022] DELETE /identity/v3/users/a0076c50aa3a4170a66333843972fca8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:54.474185 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:54.474482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:54.474771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:54.492721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:54.493929 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:54.554965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1289/2509] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:54.564642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:54.566622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:54.581129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:54.628522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b92f9-2a54-4fe7-a7e1-2bd8e12860a5 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:54.632156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:54.632808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:54.633095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:54.633380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:54.642385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:54.644382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:54.654191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1221/2510] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:54.928348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:54.929807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:54.942011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfbc19-5e65-47e8-8a64-c7592b79374d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:54.946820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:54.947745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:54.948032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:54.948530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] PATH_INFO: `/v3/projects/f751b1f880a24580bb782c96db3a754f` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:54.949597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f751b1f880a24580bb782c96db3a754f)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:54.951455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:54.984549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:55.003378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f751b1f880a24580bb782c96db3a754f', 'request_id': 'req-c431aa46-589b-4d38-be58-ed1e833bbde6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.010609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f751b1f880a24580bb782c96db3a754f', 'request_id': 'req-c431aa46-589b-4d38-be58-ed1e833bbde6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.016307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f751b1f880a24580bb782c96db3a754f', 'request_id': 'req-c431aa46-589b-4d38-be58-ed1e833bbde6'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.027431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] The token cache is being invalidate because project f751b1f880a24580bb782c96db3a754f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:55.027750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.028397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.030173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1290/2511] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:54 2022] DELETE /identity/v3/projects/f751b1f880a24580bb782c96db3a754f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:55.034521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:55.044570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fde619-5a40-4e73-a039-7b98de5571c8 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:55.104517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:55.105328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:55.105620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:55.105908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] PATH_INFO: `/v3/users/b8ffe9d491444041864fdf69db85228e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:55.107202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ffe9d491444041864fdf69db85228e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:55.109076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:55.159630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ffe9d491444041864fdf69db85228e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.167033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ffe9d491444041864fdf69db85228e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.175869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ffe9d491444041864fdf69db85228e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.176619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ffe9d491444041864fdf69db85228e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.177411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ffe9d491444041864fdf69db85228e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.203999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1222/2512] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:55 2022] DELETE /identity/v3/users/b8ffe9d491444041864fdf69db85228e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:55.537490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:55.539002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:55.558368 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431aa46-589b-4d38-be58-ed1e833bbde6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:55.629686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:55.630741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:55.631174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:55.631465 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] PATH_INFO: `/v3/projects/7a4451d8d4c14d1eaf5f135d80637952` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:55.632882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4451d8d4c14d1eaf5f135d80637952)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:55.635170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:55.719572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4451d8d4c14d1eaf5f135d80637952', 'request_id': 'req-5d9b5f40-d307-498a-825d-41b065816d56'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.730902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4451d8d4c14d1eaf5f135d80637952', 'request_id': 'req-5d9b5f40-d307-498a-825d-41b065816d56'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.738813 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4451d8d4c14d1eaf5f135d80637952', 'request_id': 'req-5d9b5f40-d307-498a-825d-41b065816d56'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.752269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] The token cache is being invalidate because project 7a4451d8d4c14d1eaf5f135d80637952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:55.753293 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.754052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.758540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1291/2513] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:55 2022] DELETE /identity/v3/projects/7a4451d8d4c14d1eaf5f135d80637952 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:55.759902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:55.761396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:55.782664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a5ac7-89a8-4004-a680-52b3672b5f25 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:55.836286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:55.867171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:55.868202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:55.868787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:55.869079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] PATH_INFO: `/v3/users/b6c396bcf4e14abc8ec44b5ac463dac7` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:55.870306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c396bcf4e14abc8ec44b5ac463dac7)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:55.872337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:55.933238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c396bcf4e14abc8ec44b5ac463dac7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.941929 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c396bcf4e14abc8ec44b5ac463dac7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.951653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c396bcf4e14abc8ec44b5ac463dac7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.952524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c396bcf4e14abc8ec44b5ac463dac7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.953238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-9e075b8b-35d0-465b-a646-c25d9e8817ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c396bcf4e14abc8ec44b5ac463dac7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:55.976504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1223/2514] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:55 2022] DELETE /identity/v3/users/b6c396bcf4e14abc8ec44b5ac463dac7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:56.271704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:56.273274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:56.296205 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b5f40-d307-498a-825d-41b065816d56 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:56.352608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:56.371456 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:56.372347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.372644 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.372930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] PATH_INFO: `/v3/projects/c665a84780aa441ea45803c55445e910` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.374127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c665a84780aa441ea45803c55445e910)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:56.376078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:56.425344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c665a84780aa441ea45803c55445e910', 'request_id': 'req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:56.432279 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c665a84780aa441ea45803c55445e910', 'request_id': 'req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:56.437938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c665a84780aa441ea45803c55445e910', 'request_id': 'req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:56.449676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] The token cache is being invalidate because project c665a84780aa441ea45803c55445e910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:56.449973 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:56.450617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-75fc3dbf-105c-4f58-8612-4f9e61cf53b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:56.452256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1292/2515] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:56 2022] DELETE /identity/v3/projects/c665a84780aa441ea45803c55445e910 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:56.458893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ea35-fc0f-43be-ad82-a3ed0e0dc09d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.459217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ea35-fc0f-43be-ad82-a3ed0e0dc09d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.459759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ea35-fc0f-43be-ad82-a3ed0e0dc09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.477838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b807ea35-fc0f-43be-ad82-a3ed0e0dc09d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:56.479081 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b807ea35-fc0f-43be-ad82-a3ed0e0dc09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:56.559112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1224/2516] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:56.568182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c7c4-0c9a-455b-8684-9e023e369d6a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.568677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c7c4-0c9a-455b-8684-9e023e369d6a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.568782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c7c4-0c9a-455b-8684-9e023e369d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.590396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-5f31c7c4-0c9a-455b-8684-9e023e369d6a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:56.592295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5f31c7c4-0c9a-455b-8684-9e023e369d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:56.607599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1293/2517] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:56.611310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ea35-fc0f-43be-ad82-a3ed0e0dc09d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:56.625034 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ea35-fc0f-43be-ad82-a3ed0e0dc09d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:56.631320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:56.632048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.632339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.633172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.633913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:56.634225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:56.635864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:56.651880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1225/2518] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:56:56.654115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c7c4-0c9a-455b-8684-9e023e369d6a None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:56.662400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c7c4-0c9a-455b-8684-9e023e369d6a None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:56.667584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:56.670719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.671049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.671339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.672222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:56.674170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:56.718262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1294/2519] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:56 2022] POST /identity/v3/projects => generated 391 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:56.722571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:56.743220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327571c4-c0e9-4635-834a-d7c7b70287be admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:56.793192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:56.825171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:56.826299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.826579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.826873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.827680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:56.829748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:56.851856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1226/2520] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:56 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:56.856152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:56.874840 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d6d43-0eba-4115-aca1-bdee83645820 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:56.892865 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:56.894683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.895097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.895457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.896297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:56.898435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:56.913938 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1295/2521] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:56.917761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:56.930163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504179-9850-4278-848c-dc0b25460798 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:56.941621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a56a02-6038-4ba3-8bec-3725b96b2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:56.943000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56a02-6038-4ba3-8bec-3725b96b2a73 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.943653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56a02-6038-4ba3-8bec-3725b96b2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.945791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56a02-6038-4ba3-8bec-3725b96b2a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:56.945791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a56a02-6038-4ba3-8bec-3725b96b2a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:56.947046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a56a02-6038-4ba3-8bec-3725b96b2a73 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:56.961837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1227/2522] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:56.965366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:56.979435 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b804a59-3cf5-4838-ac06-5d6cbb52f305 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:56.994953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:56.995650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:56.995650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:56.995898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] PATH_INFO: `/v3/projects/befcf496245147a3b81c33e9067a13c6/users/94b41a2f4361463ba47ce468213ecf97/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:57.033698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=befcf496245147a3b81c33e9067a13c6, user_id=94b41a2f4361463ba47ce468213ecf97, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:57.037387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:57.052951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1296/2523] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:56 2022] PUT /identity/v3/projects/befcf496245147a3b81c33e9067a13c6/users/94b41a2f4361463ba47ce468213ecf97/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:57.064742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:57.065408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:57.065770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:57.092845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] MFA Rules not processed for user `94b41a2f4361463ba47ce468213ecf97`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:57.094113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:57.173836 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1228/2524] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:57.188879 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:57.191296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:57.270740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f21c1d-b230-4942-8831-a50d3bafc31a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:57.276025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:57.277069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:57.277583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:57.278069 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:57.291174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:57.292870 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:57.305390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1297/2525] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:57.434868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:57.436492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:57.526340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:57.528334 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:57.559221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:57.573751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b14a7c-33dd-4778-9cc9-6b4611e62e86 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:57.586812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:57.587685 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:57.588040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:57.588439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:57.590642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:57.614602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:57.617774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:57.632468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1229/2526] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:57.670373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc12b2-3fc9-4dce-ad77-84d7370d446d service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:57.676211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:57.677373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:57.677736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:57.678104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] PATH_INFO: `/v3/users/60a36e18710443359ba2a56ad2810043` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:57.679510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a36e18710443359ba2a56ad2810043)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:57.681603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:57.768917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a36e18710443359ba2a56ad2810043'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:57.777770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a36e18710443359ba2a56ad2810043'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:57.778710 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a36e18710443359ba2a56ad2810043'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:57.790419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a36e18710443359ba2a56ad2810043'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:57.806647 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2f6b8b43-5d6d-40c6-8fb4-288377c738a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a36e18710443359ba2a56ad2810043'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:57.816767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1298/2527] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:56:57 2022] DELETE /identity/v3/users/60a36e18710443359ba2a56ad2810043 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:57.995532 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.014031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ecbe-a028-4f6d-8910-e86517a32f5a service placement] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.055134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:58.075586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.076793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.076793 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.077048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] PATH_INFO: `/v3/projects/b4944c36091d4f5f84e06386ee5a1589` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.078208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4944c36091d4f5f84e06386ee5a1589)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.080127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.129211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4944c36091d4f5f84e06386ee5a1589', 'request_id': 'req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:58.136989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4944c36091d4f5f84e06386ee5a1589', 'request_id': 'req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:58.142670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4944c36091d4f5f84e06386ee5a1589', 'request_id': 'req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:58.154339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] The token cache is being invalidate because project b4944c36091d4f5f84e06386ee5a1589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:56:58.154630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:58.155426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0bb55e10-d0c2-4ca6-9a28-1f7f0e20de89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:56:58.156974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1230/2528] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:56:57 2022] DELETE /identity/v3/projects/b4944c36091d4f5f84e06386ee5a1589 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:58.162092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a932f-5139-4e7a-a54d-bbd3c4ed8ca5 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.162457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a932f-5139-4e7a-a54d-bbd3c4ed8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.162746 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a932f-5139-4e7a-a54d-bbd3c4ed8ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.182600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f80a932f-5139-4e7a-a54d-bbd3c4ed8ca5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:58.183869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f80a932f-5139-4e7a-a54d-bbd3c4ed8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:58.245726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1299/2529] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:58.254273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca4eb-d031-4891-9a82-0077cc39c5c4 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.254620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca4eb-d031-4891-9a82-0077cc39c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.255021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca4eb-d031-4891-9a82-0077cc39c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.275587 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-26aca4eb-d031-4891-9a82-0077cc39c5c4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:58.276874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-26aca4eb-d031-4891-9a82-0077cc39c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:58.286321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1231/2530] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:58.290494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a932f-5139-4e7a-a54d-bbd3c4ed8ca5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.301230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a932f-5139-4e7a-a54d-bbd3c4ed8ca5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.305736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.306397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.306686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.306998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.307726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:56:58.308039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.309636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.326132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1300/2531] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:56:58.327452 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca4eb-d031-4891-9a82-0077cc39c5c4 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.337082 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca4eb-d031-4891-9a82-0077cc39c5c4 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.341852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.342510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.342796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.343124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.343857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.345742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.377639 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1232/2532] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:58 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:58.379623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.390810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd63b-e30a-46e8-a484-343d884c72aa admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.408563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:58.452202 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.452902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.453195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.453508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.454204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.456704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.478051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1301/2533] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:58 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:56:58.482253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.493566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743342b1-c760-4fd1-b9f9-acf0dfb8cc26 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.498283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.498894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.499285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.499571 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.500300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.501905 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.512354 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1233/2534] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:56:58.516685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.526666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27858b-581c-4999-92ed-b934565dcd5b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.531290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792139e9-f757-489b-a270-1edc60af1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.531957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792139e9-f757-489b-a270-1edc60af1d23 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.532248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792139e9-f757-489b-a270-1edc60af1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.532533 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792139e9-f757-489b-a270-1edc60af1d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.533297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792139e9-f757-489b-a270-1edc60af1d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.535429 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792139e9-f757-489b-a270-1edc60af1d23 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.545487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1302/2535] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:56:58.549394 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.559964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e3a4e-0715-4044-9111-bada5622a526 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.564509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.565412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.565701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.565982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] PATH_INFO: `/v3/projects/b7303d5295a147a58e9e2970ef3eadfb/users/fca7563ed29840be92d6a996313359f9/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.580306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7303d5295a147a58e9e2970ef3eadfb, user_id=fca7563ed29840be92d6a996313359f9, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.582974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.597314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1234/2536] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:58 2022] PUT /identity/v3/projects/b7303d5295a147a58e9e2970ef3eadfb/users/fca7563ed29840be92d6a996313359f9/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:56:58.607211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18cb2-c146-427c-8585-e0c8a77f91d7 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.607510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18cb2-c146-427c-8585-e0c8a77f91d7 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.607796 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18cb2-c146-427c-8585-e0c8a77f91d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.634656 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-43c18cb2-c146-427c-8585-e0c8a77f91d7 None None] MFA Rules not processed for user `fca7563ed29840be92d6a996313359f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:58.635885 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-43c18cb2-c146-427c-8585-e0c8a77f91d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:58.697913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1303/2537] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:56:58.702279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.762635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d97e-8e5b-4c6f-8fb0-5a6a85e9e0c0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.767252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.767966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.768250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.768536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.769266 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.771212 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.781022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:58.803191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1235/2538] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:56:58 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:58.804099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18cb2-c146-427c-8585-e0c8a77f91d7 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.815440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18cb2-c146-427c-8585-e0c8a77f91d7 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.871786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.872467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.872778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.873061 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.873749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.875689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.896404 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1304/2539] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:56:58 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:56:58.900724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.911500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71fb2c-8309-4caa-b6a4-96586545b7ba admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.916774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.917473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.917764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.918049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.918783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.920425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.931514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1236/2540] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:56:58.935847 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:58.946331 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85d8b0-6101-4d1b-b71b-6920a112e6b2 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:58.953256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:58.954941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:58.955301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:58.955569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] PATH_INFO: `/v3/projects/83ef337c3891431b8ddd10a53121592d/users/d4f369d8bc69413e86376048de86f991/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:58.974232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ef337c3891431b8ddd10a53121592d, user_id=d4f369d8bc69413e86376048de86f991, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:58.976756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:58.979697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:58.994232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1305/2541] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:58 2022] PUT /identity/v3/projects/83ef337c3891431b8ddd10a53121592d/users/d4f369d8bc69413e86376048de86f991/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:58.999804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:59.010350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac205da-2b1c-4610-a2d2-950dd1a30745 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:59.067010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea092-11cf-470c-ab3c-dfe522cdc47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:59.067609 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea092-11cf-470c-ab3c-dfe522cdc47a admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:59.067901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea092-11cf-470c-ab3c-dfe522cdc47a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:59.068180 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea092-11cf-470c-ab3c-dfe522cdc47a admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:59.068896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea092-11cf-470c-ab3c-dfe522cdc47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:59.070511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea092-11cf-470c-ab3c-dfe522cdc47a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:59.079950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1237/2542] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:56:59.084654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:59.095113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eff94-4aa4-447b-8473-e1373004b8e3 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:59.100277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:59.101163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:59.101450 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:59.101727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] PATH_INFO: `/v3/projects/83ef337c3891431b8ddd10a53121592d/users/d4f369d8bc69413e86376048de86f991/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:59.103722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ef337c3891431b8ddd10a53121592d, user_id=d4f369d8bc69413e86376048de86f991, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:59.106357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:59.116528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1306/2543] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:56:59 2022] PUT /identity/v3/projects/83ef337c3891431b8ddd10a53121592d/users/d4f369d8bc69413e86376048de86f991/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:56:59.127798 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:59.128118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:59.128396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:59.154510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] MFA Rules not processed for user `d4f369d8bc69413e86376048de86f991`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:56:59.155738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:59.220735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1238/2544] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:56:59.232467 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:59.234134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:59.289857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc682619-09ef-4ab7-a8f0-e720787e8ce7 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:59.293754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:59.294397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:59.294689 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:59.294996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:59.303910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:59.305335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:59.314718 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1307/2545] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:56:59.357507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:56:59.358966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:56:59.370786 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e26f2a-e740-44e8-a047-bcb774a3548b None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:56:59.374402 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4547445-29f3-42f7-a35f-f63caa07684c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:56:59.375076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4547445-29f3-42f7-a35f-f63caa07684c service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:56:59.375368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4547445-29f3-42f7-a35f-f63caa07684c service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:56:59.375681 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4547445-29f3-42f7-a35f-f63caa07684c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:56:59.433238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4547445-29f3-42f7-a35f-f63caa07684c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:56:59.434721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4547445-29f3-42f7-a35f-f63caa07684c service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:56:59.439869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:56:59.451208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1239/2546] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:02.695761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:02.760789 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356286ed-34e7-41ba-b69f-03b73c34c1c7 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:02.765286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:02.766159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:02.766448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:02.766729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] PATH_INFO: `/v3/users/fca7563ed29840be92d6a996313359f9` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:02.767929 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca7563ed29840be92d6a996313359f9)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:02.769852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:02.814162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca7563ed29840be92d6a996313359f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:02.822841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca7563ed29840be92d6a996313359f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:02.823455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca7563ed29840be92d6a996313359f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:02.830424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca7563ed29840be92d6a996313359f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:02.842109 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca7563ed29840be92d6a996313359f9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:02.847982 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1308/2547] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:02 2022] DELETE /identity/v3/users/fca7563ed29840be92d6a996313359f9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:02.852600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:02.853055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:02.853179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:02.870814 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:02.872050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:02.932675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1240/2548] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:02.942721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:02.944137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:02.949633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:03.005964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486590f-7ccb-451d-aa26-929730996e6e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:03.009685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:03.010341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:03.010632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:03.010939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:03.020053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:03.021493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:03.031402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1309/2549] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:03.353557 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:03.355025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:03.367913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb26c-cc24-4d9c-a10c-021596630e75 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:03.372902 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:03.373870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:03.374221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:03.374598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] PATH_INFO: `/v3/projects/b7303d5295a147a58e9e2970ef3eadfb` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:03.375876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7303d5295a147a58e9e2970ef3eadfb)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:03.378446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:03.434651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7303d5295a147a58e9e2970ef3eadfb', 'request_id': 'req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.442877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7303d5295a147a58e9e2970ef3eadfb', 'request_id': 'req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.448505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7303d5295a147a58e9e2970ef3eadfb', 'request_id': 'req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.460079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] The token cache is being invalidate because project b7303d5295a147a58e9e2970ef3eadfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:03.460372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.461047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.462741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1241/2550] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:03 2022] DELETE /identity/v3/projects/b7303d5295a147a58e9e2970ef3eadfb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:03.466773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:03.476909 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b745af-9b78-42b8-8947-20350b2ace5d service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:03.536711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:03.537606 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:03.537891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:03.538169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] PATH_INFO: `/v3/users/d4f369d8bc69413e86376048de86f991` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:03.539408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f369d8bc69413e86376048de86f991)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:03.541599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:03.588886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f369d8bc69413e86376048de86f991'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.596542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f369d8bc69413e86376048de86f991'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.597163 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f369d8bc69413e86376048de86f991'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.604195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f369d8bc69413e86376048de86f991'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.616583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e48a1d91-76e8-4502-9dec-6b7b7e67f0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f369d8bc69413e86376048de86f991'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:03.622397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1310/2551] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:03 2022] DELETE /identity/v3/users/d4f369d8bc69413e86376048de86f991 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:03.897934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:03.899416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:03.915105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c1b28-7bf6-445b-8c38-ba3fa66fb20e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:03.972086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:03.972896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:03.973185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:03.973468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] PATH_INFO: `/v3/projects/83ef337c3891431b8ddd10a53121592d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:03.974651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ef337c3891431b8ddd10a53121592d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:03.976631 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.006379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:04.024477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ef337c3891431b8ddd10a53121592d', 'request_id': 'req-e0894061-8333-4f3f-acab-249561358a8a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:04.031640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ef337c3891431b8ddd10a53121592d', 'request_id': 'req-e0894061-8333-4f3f-acab-249561358a8a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:04.037914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ef337c3891431b8ddd10a53121592d', 'request_id': 'req-e0894061-8333-4f3f-acab-249561358a8a'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:04.049011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] The token cache is being invalidate because project 83ef337c3891431b8ddd10a53121592d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:04.049306 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:04.050555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-e0894061-8333-4f3f-acab-249561358a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:04.052123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1242/2552] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:03 2022] DELETE /identity/v3/projects/83ef337c3891431b8ddd10a53121592d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:04.057519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a98cbe-a3dc-4233-ad10-c6d03c89a8ac None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.058009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a98cbe-a3dc-4233-ad10-c6d03c89a8ac None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.058108 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a98cbe-a3dc-4233-ad10-c6d03c89a8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.075992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-03a98cbe-a3dc-4233-ad10-c6d03c89a8ac None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:04.077196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-03a98cbe-a3dc-4233-ad10-c6d03c89a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:04.098376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:04.142957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1311/2553] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:04.148932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6845-f58e-4ee0-b53d-6073eaff8cfa None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.149297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6845-f58e-4ee0-b53d-6073eaff8cfa None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.149586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6845-f58e-4ee0-b53d-6073eaff8cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.168203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-732a6845-f58e-4ee0-b53d-6073eaff8cfa None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:04.169408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-732a6845-f58e-4ee0-b53d-6073eaff8cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:04.177407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1243/2554] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:04.181668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a98cbe-a3dc-4233-ad10-c6d03c89a8ac None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.191507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a98cbe-a3dc-4233-ad10-c6d03c89a8ac None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.196122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.196825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.197115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.197397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.198129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:04.198442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.200080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.212383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1312/2555] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:04.216654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a6845-f58e-4ee0-b53d-6073eaff8cfa None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.226387 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a6845-f58e-4ee0-b53d-6073eaff8cfa None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.231120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.231844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.232544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.232544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.233375 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.235328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.264645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1244/2556] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:04.266115 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.277220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1dacd-022b-48d7-ae77-47e5f4191fad admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.341245 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.341927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.342220 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.342504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.343240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.345165 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.364824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1313/2557] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:04.368894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.379695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c1131-2bfe-4734-9228-b5a49ff34c6f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.384280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.384941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.385232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.385518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.386245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.387885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.398031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1245/2558] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:04.401850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.411758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a26655-232d-433e-9405-f8511cc33c9e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.416685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22403f6-96b1-4333-941e-64a3bd998d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.417343 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22403f6-96b1-4333-941e-64a3bd998d32 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.417638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22403f6-96b1-4333-941e-64a3bd998d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.417941 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22403f6-96b1-4333-941e-64a3bd998d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.418657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22403f6-96b1-4333-941e-64a3bd998d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.421193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22403f6-96b1-4333-941e-64a3bd998d32 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.431609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1314/2559] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:04.435774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.445719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6720a29-7907-4604-ba00-9357727d8003 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.451143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.452032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.452323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.452606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] PATH_INFO: `/v3/projects/b8a2e06d655b4799ba883445f9287733/users/7e2f59b783574310ba5dfa9ebd4f28fd/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.467135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a2e06d655b4799ba883445f9287733, user_id=7e2f59b783574310ba5dfa9ebd4f28fd, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.469760 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.483472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1246/2560] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:04 2022] PUT /identity/v3/projects/b8a2e06d655b4799ba883445f9287733/users/7e2f59b783574310ba5dfa9ebd4f28fd/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:04.493570 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abcc6-f9f7-41be-9232-a8baa0fd3d16 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.493896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abcc6-f9f7-41be-9232-a8baa0fd3d16 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.494187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abcc6-f9f7-41be-9232-a8baa0fd3d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.521406 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-912abcc6-f9f7-41be-9232-a8baa0fd3d16 None None] MFA Rules not processed for user `7e2f59b783574310ba5dfa9ebd4f28fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:04.522634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-912abcc6-f9f7-41be-9232-a8baa0fd3d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:04.586461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1315/2561] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:04.592304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.652138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59fbb9-dbcc-4967-8c13-51bfaee208ba admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.657014 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.657673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.657976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.658302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.659077 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.661297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.686403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1247/2562] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:04.690687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912abcc6-f9f7-41be-9232-a8baa0fd3d16 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.701492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912abcc6-f9f7-41be-9232-a8baa0fd3d16 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.718576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:04.759957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.760567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.760858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.761141 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.761842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.763811 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.783041 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1316/2563] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:04.787210 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.797553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213ca2-cf23-4bc2-9554-4924450521a6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.802127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.802788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.803118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.803406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.804138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.805908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.817883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1248/2564] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:04.822010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.832927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697fb17-861d-4603-af22-8819e8f2c63a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.837625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.838506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.838825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.839148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] PATH_INFO: `/v3/projects/1d5be53e37d64c19b09a39445dab0b84/users/72008b7278624e9598839125fb6e8490/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.853797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5be53e37d64c19b09a39445dab0b84, user_id=72008b7278624e9598839125fb6e8490, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.856597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.869568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1317/2565] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:04 2022] PUT /identity/v3/projects/1d5be53e37d64c19b09a39445dab0b84/users/72008b7278624e9598839125fb6e8490/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:04.873342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.883864 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d0980-77d1-44d8-986e-1221be4f1243 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.902884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:04.940573 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46e908-5089-465b-bf5e-0f7f8d641b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.941271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46e908-5089-465b-bf5e-0f7f8d641b8e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.941562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46e908-5089-465b-bf5e-0f7f8d641b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.941842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46e908-5089-465b-bf5e-0f7f8d641b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.942564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46e908-5089-465b-bf5e-0f7f8d641b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.944184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46e908-5089-465b-bf5e-0f7f8d641b8e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.953648 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1249/2566] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:04.958294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:04.968430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25032a0-dcdc-47bc-929c-5f88b978de13 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:04.973617 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:04.974495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:04.974782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:04.975101 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] PATH_INFO: `/v3/projects/1d5be53e37d64c19b09a39445dab0b84/users/72008b7278624e9598839125fb6e8490/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:04.977055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5be53e37d64c19b09a39445dab0b84, user_id=72008b7278624e9598839125fb6e8490, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:04.979727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:04.989686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1318/2567] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:04 2022] PUT /identity/v3/projects/1d5be53e37d64c19b09a39445dab0b84/users/72008b7278624e9598839125fb6e8490/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:05.000496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca0b2-0c0f-45cb-ba0a-540727589d28 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:05.000796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca0b2-0c0f-45cb-ba0a-540727589d28 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:05.001083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca0b2-0c0f-45cb-ba0a-540727589d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:05.026898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1b2ca0b2-0c0f-45cb-ba0a-540727589d28 None None] MFA Rules not processed for user `72008b7278624e9598839125fb6e8490`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:05.028067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1b2ca0b2-0c0f-45cb-ba0a-540727589d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:05.095995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1250/2568] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:05.107836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:05.109528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:05.165377 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f28a87-ad0f-4f46-b847-1b19e75aab50 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:05.169258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:05.169897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:05.170182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:05.170462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:05.180232 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:05.181663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:05.192135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1319/2569] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:05.506372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ca0b2-0c0f-45cb-ba0a-540727589d28 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:05.515346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ca0b2-0c0f-45cb-ba0a-540727589d28 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:05.519811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72008b7278624e9598839125fb6e8490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5be53e37d64c19b09a39445dab0b84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:05.520468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:05.520761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:05.521046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:05.521779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:05.522092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:05.523718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:05.535425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1251/2570] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:05.539438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:05.548783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03655336-bc36-4bcb-8ff6-20115d0b621b service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:05.553914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72008b7278624e9598839125fb6e8490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5be53e37d64c19b09a39445dab0b84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:05.554600 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:05.554891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:05.555204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:05.555893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:05.557780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:05.583315 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1320/2571] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:05 2022] POST /identity/v3/projects => generated 353 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:05.587389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:05.598959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bc130-1ccb-417a-8eda-e6e667edd3b1 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:05.653984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72008b7278624e9598839125fb6e8490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5be53e37d64c19b09a39445dab0b84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:05.654672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:05.655005 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:05.655300 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:05.656028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:05.656345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:05.657947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:05.669976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1252/2572] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:57:05.704524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:05.715182 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60f95-fc64-454b-b016-626c30fd7870 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:05.719721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72008b7278624e9598839125fb6e8490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5be53e37d64c19b09a39445dab0b84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:05.720593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:05.720887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:05.721173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] PATH_INFO: `/v3/projects/234cd73d52024bf28911c12ffd070711` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:05.723003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=234cd73d52024bf28911c12ffd070711)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:05.724965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:05.768947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:05.770255 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234cd73d52024bf28911c12ffd070711', 'request_id': 'req-4192f99e-55da-4d35-9ede-005591c41aee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:05.778097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234cd73d52024bf28911c12ffd070711', 'request_id': 'req-4192f99e-55da-4d35-9ede-005591c41aee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:05.784106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234cd73d52024bf28911c12ffd070711', 'request_id': 'req-4192f99e-55da-4d35-9ede-005591c41aee'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:05.795176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] The token cache is being invalidate because project 234cd73d52024bf28911c12ffd070711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:05.795468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:05.796100 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-4192f99e-55da-4d35-9ede-005591c41aee tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:05.797638 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1321/2573] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:05 2022] DELETE /identity/v3/projects/234cd73d52024bf28911c12ffd070711 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:05.979582 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:05.981399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:06.012038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:06.052807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf34ff-b0b4-413f-a88f-3fd14b901f88 tempest-VolumeQuotaClassesTest-1944979186 tempest-VolumeQuotaClassesTest-1944979186-project-admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:06.108232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:06.109026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:06.109329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:06.109606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] PATH_INFO: `/v3/users/7e2f59b783574310ba5dfa9ebd4f28fd` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:06.110796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2f59b783574310ba5dfa9ebd4f28fd)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:06.112802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:06.159227 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2f59b783574310ba5dfa9ebd4f28fd'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.166416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2f59b783574310ba5dfa9ebd4f28fd'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.173413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2f59b783574310ba5dfa9ebd4f28fd'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.174040 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2f59b783574310ba5dfa9ebd4f28fd'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.174655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2f59b783574310ba5dfa9ebd4f28fd'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.192401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1253/2574] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:05 2022] DELETE /identity/v3/users/7e2f59b783574310ba5dfa9ebd4f28fd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:06.196864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:06.197358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:06.197489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:06.215372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:06.216559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:06.274325 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1322/2575] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:06.283811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:06.285194 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:06.342488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438b65a-cab3-4649-9add-9fcde0d43b42 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:06.346233 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:06.346888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:06.347216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:06.347500 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:06.355397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:06.357952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:06.359938 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:06.372336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1254/2576] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:57:06.639362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:06.640783 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:06.667427 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d99c-2b91-49f5-9212-a044b57e4d6b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:06.672645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:06.673522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:06.673807 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:06.674083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] PATH_INFO: `/v3/projects/b8a2e06d655b4799ba883445f9287733` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:06.675862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a2e06d655b4799ba883445f9287733)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:06.677763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:06.724604 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a2e06d655b4799ba883445f9287733', 'request_id': 'req-80c0b77a-6522-4fd0-bf49-8238c5d72139'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.731788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a2e06d655b4799ba883445f9287733', 'request_id': 'req-80c0b77a-6522-4fd0-bf49-8238c5d72139'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.738181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a2e06d655b4799ba883445f9287733', 'request_id': 'req-80c0b77a-6522-4fd0-bf49-8238c5d72139'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.749045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] The token cache is being invalidate because project b8a2e06d655b4799ba883445f9287733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:06.749341 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.750014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.751597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1323/2577] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:06 2022] DELETE /identity/v3/projects/b8a2e06d655b4799ba883445f9287733 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:06.755558 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:06.765055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fef94-6d5c-4ebf-a8e9-861d9091ae76 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:06.820955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:06.821838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:06.822128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:06.822411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] PATH_INFO: `/v3/users/72008b7278624e9598839125fb6e8490` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:06.823598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72008b7278624e9598839125fb6e8490)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:06.825594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:06.869096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72008b7278624e9598839125fb6e8490'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.875849 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72008b7278624e9598839125fb6e8490'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.883168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72008b7278624e9598839125fb6e8490'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.883718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72008b7278624e9598839125fb6e8490'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.884333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-49c9e655-6118-4126-9a82-3dc2d051b7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72008b7278624e9598839125fb6e8490'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:06.901411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1255/2578] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:06 2022] DELETE /identity/v3/users/72008b7278624e9598839125fb6e8490 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:07.175503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.176934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:07.189678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b77a-6522-4fd0-bf49-8238c5d72139 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.247747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.248636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.248927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.249211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] PATH_INFO: `/v3/projects/1d5be53e37d64c19b09a39445dab0b84` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.250451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5be53e37d64c19b09a39445dab0b84)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.252403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.254296 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:07.301402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5be53e37d64c19b09a39445dab0b84', 'request_id': 'req-8d33f237-497c-47d5-91bf-0b992e59827f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:07.308413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5be53e37d64c19b09a39445dab0b84', 'request_id': 'req-8d33f237-497c-47d5-91bf-0b992e59827f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:07.313918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5be53e37d64c19b09a39445dab0b84', 'request_id': 'req-8d33f237-497c-47d5-91bf-0b992e59827f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:07.324724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] The token cache is being invalidate because project 1d5be53e37d64c19b09a39445dab0b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:07.325013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:07.325640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-8d33f237-497c-47d5-91bf-0b992e59827f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:07.327366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1324/2579] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:07 2022] DELETE /identity/v3/projects/1d5be53e37d64c19b09a39445dab0b84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:07.332661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e192e-2b2b-4d14-95e8-41c5a6aace36 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.333127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e192e-2b2b-4d14-95e8-41c5a6aace36 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.333237 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e192e-2b2b-4d14-95e8-41c5a6aace36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.351101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-1c9e192e-2b2b-4d14-95e8-41c5a6aace36 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:07.352352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-1c9e192e-2b2b-4d14-95e8-41c5a6aace36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:07.415131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1256/2580] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:07.422983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b86eb-fa5f-4c2a-9e08-5386477a462e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.423233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b86eb-fa5f-4c2a-9e08-5386477a462e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.423514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b86eb-fa5f-4c2a-9e08-5386477a462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.442359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-458b86eb-fa5f-4c2a-9e08-5386477a462e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:07.443577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-458b86eb-fa5f-4c2a-9e08-5386477a462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:07.451342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1325/2581] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:07.455439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e192e-2b2b-4d14-95e8-41c5a6aace36 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.464845 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e192e-2b2b-4d14-95e8-41c5a6aace36 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.469543 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.470204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.470495 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.470781 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.472067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:07.472396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.474031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.486092 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1257/2582] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:07.491031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b86eb-fa5f-4c2a-9e08-5386477a462e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.500311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b86eb-fa5f-4c2a-9e08-5386477a462e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.505425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.506692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.506692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.506692 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.507370 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.509287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.536540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1326/2583] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:07 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:07.540790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.546217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:07.553738 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769aed-91c6-4945-a2c0-ff3bc5db9bd9 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.613143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.613825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.614108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.614385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.615098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.617036 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.638344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1258/2584] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:07 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:57:07.642508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.653298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242aa5f-3e63-4a6a-90ce-0e776293eedf admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.657888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.658587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.659412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.659711 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.660444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.662047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.674779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1327/2585] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:07.678446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.689305 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd1d2-7746-400a-9acc-1d7cdcbe7230 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.695056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719536a-515b-4591-a8d0-96ee1c326f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.699038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719536a-515b-4591-a8d0-96ee1c326f66 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.699038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719536a-515b-4591-a8d0-96ee1c326f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.699038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719536a-515b-4591-a8d0-96ee1c326f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.699038 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719536a-515b-4591-a8d0-96ee1c326f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.701321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719536a-515b-4591-a8d0-96ee1c326f66 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.717196 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1259/2586] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:57:07.718674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.728983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace8fbc-382b-4da5-b126-eef2721cd31f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.733698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.734602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.734894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.735260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] PATH_INFO: `/v3/projects/ca0724618c31461bb14da7d864073b76/users/d0f66b3f69f746e88213838beef6b319/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.751651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0724618c31461bb14da7d864073b76, user_id=d0f66b3f69f746e88213838beef6b319, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.755066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.770507 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1328/2587] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:07 2022] PUT /identity/v3/projects/ca0724618c31461bb14da7d864073b76/users/d0f66b3f69f746e88213838beef6b319/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:07.780640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a909b-496e-473e-8742-f3fe2bdb81a2 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.781030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a909b-496e-473e-8742-f3fe2bdb81a2 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.781383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a909b-496e-473e-8742-f3fe2bdb81a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.809950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-003a909b-496e-473e-8742-f3fe2bdb81a2 None None] MFA Rules not processed for user `d0f66b3f69f746e88213838beef6b319`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:07.811232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-003a909b-496e-473e-8742-f3fe2bdb81a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:07.877966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1260/2588] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:07.882526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:07.957882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a148572-68ad-419a-a616-1bb760c6059a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:07.962535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:07.963229 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:07.963519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:07.963799 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:07.964505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:07.966432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:07.994875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1329/2589] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:07 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:07.996037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a909b-496e-473e-8742-f3fe2bdb81a2 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:08.006634 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a909b-496e-473e-8742-f3fe2bdb81a2 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:08.066012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:08.066770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.067114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.067398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.068133 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:08.070269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:08.086963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:08.096086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1261/2590] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:07 2022] POST /identity/v3/users => generated 306 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:08.097047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:08.108497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86d40b-186d-493d-b9b8-3e7d34a94a7f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:08.114349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:08.115080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.115371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.115651 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.116403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:08.118029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:08.123986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:08.130751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1330/2591] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:57:08.135016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:08.146248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd814-126f-48ff-b69d-76db2b94a38e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:08.151143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:08.152061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.152350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.152635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] PATH_INFO: `/v3/projects/a39d2c7b645b4db9ac713d83aaf54506/users/b878ee5011f04ac489041283b125615e/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.169382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39d2c7b645b4db9ac713d83aaf54506, user_id=b878ee5011f04ac489041283b125615e, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:08.172098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:08.191274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1262/2592] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:08 2022] PUT /identity/v3/projects/a39d2c7b645b4db9ac713d83aaf54506/users/b878ee5011f04ac489041283b125615e/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:08.195194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:08.205463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3307aa-8a0e-4103-9519-f33619911111 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:08.265303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83adcbd-27e7-4cb2-96ee-657eb99bdd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:08.265975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83adcbd-27e7-4cb2-96ee-657eb99bdd5b admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.266262 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83adcbd-27e7-4cb2-96ee-657eb99bdd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.266541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83adcbd-27e7-4cb2-96ee-657eb99bdd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.267312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83adcbd-27e7-4cb2-96ee-657eb99bdd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:08.269513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83adcbd-27e7-4cb2-96ee-657eb99bdd5b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:08.282738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1331/2593] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:08.284211 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:08.294896 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99137-7756-44b2-8e11-45d0163ef6bd admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:08.299565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:08.300478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.300772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.301190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] PATH_INFO: `/v3/projects/a39d2c7b645b4db9ac713d83aaf54506/users/b878ee5011f04ac489041283b125615e/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.303183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39d2c7b645b4db9ac713d83aaf54506, user_id=b878ee5011f04ac489041283b125615e, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:08.305827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:08.317353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1263/2594] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:08 2022] PUT /identity/v3/projects/a39d2c7b645b4db9ac713d83aaf54506/users/b878ee5011f04ac489041283b125615e/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:08.328350 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.328735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.329092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.359275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] MFA Rules not processed for user `b878ee5011f04ac489041283b125615e`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:08.360488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:08.447910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1332/2595] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:08.461429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:08.463442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:08.536276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f551f61-90f9-48eb-96b9-e475a471ca17 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:08.542072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:08.543666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.544701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.545164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.555434 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:08.557209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:08.568408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1264/2596] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:08.657488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:08.658949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:08.671709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699be35-0c31-4b4b-b0a2-763968c97288 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:08.676200 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b082aa-707f-43ad-8f0e-1e4b611a8358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:08.676877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b082aa-707f-43ad-8f0e-1e4b611a8358 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:08.677167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b082aa-707f-43ad-8f0e-1e4b611a8358 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:08.677448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b082aa-707f-43ad-8f0e-1e4b611a8358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:08.773648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b082aa-707f-43ad-8f0e-1e4b611a8358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:08.775007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b082aa-707f-43ad-8f0e-1e4b611a8358 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:08.797392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1333/2597] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:17.037483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:17.102838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b26183-5609-45de-aa5b-50ad4bad1e5b service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:17.108859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:17.109922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:17.110221 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:17.110510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] PATH_INFO: `/v3/users/d0f66b3f69f746e88213838beef6b319` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:17.111743 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f66b3f69f746e88213838beef6b319)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:17.114197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:17.158209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f66b3f69f746e88213838beef6b319'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.165425 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f66b3f69f746e88213838beef6b319'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.172746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f66b3f69f746e88213838beef6b319'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.173378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f66b3f69f746e88213838beef6b319'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.173994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f66b3f69f746e88213838beef6b319'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.178419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:17.193418 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1265/2598] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:17 2022] DELETE /identity/v3/users/d0f66b3f69f746e88213838beef6b319 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:17.197894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:17.198378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:17.198473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:17.215426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:17.216607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:17.229398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:17.275005 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1334/2599] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:17.285199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:17.286580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:17.341831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75fa6-3da2-4f06-ab4d-791247510a62 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:17.345628 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:17.346273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:17.346627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:17.346987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:17.356328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:17.357774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:17.367277 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1266/2600] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:17.626155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:17.627652 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:17.647965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0272a-b057-46ec-a08f-4482232b5732 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:17.659152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:17.659152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:17.659152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:17.659152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] PATH_INFO: `/v3/projects/ca0724618c31461bb14da7d864073b76` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:17.659632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0724618c31461bb14da7d864073b76)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:17.661587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:17.726972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0724618c31461bb14da7d864073b76', 'request_id': 'req-f326d720-359f-483c-8985-92eea27fb20a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.733394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0724618c31461bb14da7d864073b76', 'request_id': 'req-f326d720-359f-483c-8985-92eea27fb20a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.744160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0724618c31461bb14da7d864073b76', 'request_id': 'req-f326d720-359f-483c-8985-92eea27fb20a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.761695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] The token cache is being invalidate because project ca0724618c31461bb14da7d864073b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:17.761695 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.766564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.767316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1335/2601] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:17 2022] DELETE /identity/v3/projects/ca0724618c31461bb14da7d864073b76 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:17.771654 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:17.772098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:17.773591 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:17.793414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da773d4-9e31-456b-8fb1-b01214e9232f service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:17.831439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326d720-359f-483c-8985-92eea27fb20a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:17.835349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:17.835993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:17.836284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:17.836566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:17.838354 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:17.851057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:17.851952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:17.852258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:17.852528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] PATH_INFO: `/v3/users/b878ee5011f04ac489041283b125615e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:17.853718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b878ee5011f04ac489041283b125615e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:17.855675 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:17.903858 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:17.906497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b878ee5011f04ac489041283b125615e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.907671 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:17.910194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:17.915637 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b878ee5011f04ac489041283b125615e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.923709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1336/2602] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:57:17.925869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b878ee5011f04ac489041283b125615e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.926590 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b878ee5011f04ac489041283b125615e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.927216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-6c9e7856-c0f2-42d9-af4a-1ede252a0302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b878ee5011f04ac489041283b125615e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:17.947313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1267/2603] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:17 2022] DELETE /identity/v3/users/b878ee5011f04ac489041283b125615e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:18.228561 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.230176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:18.247158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75576a6-619f-4db7-8b7b-94c24d8944be service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.311194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.312097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.312390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.312675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] PATH_INFO: `/v3/projects/a39d2c7b645b4db9ac713d83aaf54506` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.313917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39d2c7b645b4db9ac713d83aaf54506)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.316082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.367479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39d2c7b645b4db9ac713d83aaf54506', 'request_id': 'req-f1a0b454-a3a7-4001-b33b-018ca63bfc17'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.375393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39d2c7b645b4db9ac713d83aaf54506', 'request_id': 'req-f1a0b454-a3a7-4001-b33b-018ca63bfc17'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.381271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39d2c7b645b4db9ac713d83aaf54506', 'request_id': 'req-f1a0b454-a3a7-4001-b33b-018ca63bfc17'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.392446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] The token cache is being invalidate because project a39d2c7b645b4db9ac713d83aaf54506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:18.392741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.393979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f1a0b454-a3a7-4001-b33b-018ca63bfc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.395996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1337/2604] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:18 2022] DELETE /identity/v3/projects/a39d2c7b645b4db9ac713d83aaf54506 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:18.400817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4a54a-bbee-416f-9997-5981ee66e22f None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.401282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4a54a-bbee-416f-9997-5981ee66e22f None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.401426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4a54a-bbee-416f-9997-5981ee66e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.414621 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:18.422200 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7ef4a54a-bbee-416f-9997-5981ee66e22f None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:18.424141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7ef4a54a-bbee-416f-9997-5981ee66e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:18.487964 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1268/2605] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:18.495657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceee12f-bf11-4dec-b853-abfd18da3203 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.495952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceee12f-bf11-4dec-b853-abfd18da3203 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.496234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceee12f-bf11-4dec-b853-abfd18da3203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.515145 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9ceee12f-bf11-4dec-b853-abfd18da3203 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:18.516344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9ceee12f-bf11-4dec-b853-abfd18da3203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:18.524470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1338/2606] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:18.528620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4a54a-bbee-416f-9997-5981ee66e22f None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.538479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4a54a-bbee-416f-9997-5981ee66e22f None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.543487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.544162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.544449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.544729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.545463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:18.545770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.547395 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.562660 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1269/2607] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:18.563797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceee12f-bf11-4dec-b853-abfd18da3203 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.573518 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceee12f-bf11-4dec-b853-abfd18da3203 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.578099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.578754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.579070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.579353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.580044 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.581926 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.612884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1339/2608] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:18 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:18.614078 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.623973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ab83-9786-4eb0-a52c-0cd951f63503 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.683474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.684167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.684577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.684869 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.685569 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.687514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.719535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1270/2609] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:18 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:18.722016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.732486 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e99a4-a8ac-40f9-aa52-e45273519935 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.737814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.738438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.738732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.739054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.739861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.741466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.752761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1340/2610] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:18.756888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.767108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613c50-ea16-4968-a1a9-b83ae180ad28 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.772156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.772834 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.773125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.773412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.774153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.775807 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.787028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1271/2611] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:18.791927 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.802708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1136-8aec-4033-b5a6-4059272ca368 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.807564 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e14fb-5c65-4255-82cf-ebbd76806671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.808433 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e14fb-5c65-4255-82cf-ebbd76806671 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.808745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e14fb-5c65-4255-82cf-ebbd76806671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.809028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e14fb-5c65-4255-82cf-ebbd76806671 admin admin] PATH_INFO: `/v3/projects/7d91db624f5346278f258d171988fd6d/users/22bf085848244aceaf04c4354b047374/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.819108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.821280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:18.825380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e14fb-5c65-4255-82cf-ebbd76806671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d91db624f5346278f258d171988fd6d, user_id=22bf085848244aceaf04c4354b047374, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.828059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e14fb-5c65-4255-82cf-ebbd76806671 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.835264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015d241-631b-4790-ae91-2f12b4455b9d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:18.840488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:18.841474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.841673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.841940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] PATH_INFO: `/v3/users/94b41a2f4361463ba47ce468213ecf97` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.843182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b41a2f4361463ba47ce468213ecf97)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:18.845247 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1341/2612] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:18 2022] PUT /identity/v3/projects/7d91db624f5346278f258d171988fd6d/users/22bf085848244aceaf04c4354b047374/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:18.845610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:18.857414 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.858284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.858629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.894688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] MFA Rules not processed for user `22bf085848244aceaf04c4354b047374`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:18.895959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:18.900601 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b41a2f4361463ba47ce468213ecf97'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.905291 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:18.912188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b41a2f4361463ba47ce468213ecf97'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.920649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b41a2f4361463ba47ce468213ecf97'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.921281 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b41a2f4361463ba47ce468213ecf97'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.921927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-67dcbdd4-dfd9-43f3-a6ac-8a9405de1062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b41a2f4361463ba47ce468213ecf97'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:18.927369 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:18.943231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1272/2613] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:18 2022] DELETE /identity/v3/users/94b41a2f4361463ba47ce468213ecf97 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:18.947667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:18.947963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:18.948250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:18.967202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:18.968407 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:18.975924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1342/2614] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:18.980286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:18.981701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:19.037893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1273/2615] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:19.048593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.050457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:19.050579 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fc66-974c-43a1-ae46-25baab5b3593 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.055147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.055872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.056169 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.056454 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.057167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.059225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.095029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1343/2616] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:18 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:19.097396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.138656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda6e5e-82b9-449d-aef8-fbd7291fe738 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.185020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72088ed-1d87-46fe-befa-7971d41597ef admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.190031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.191598 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.191970 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.192328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.193116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.195166 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.204045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.205242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.205642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.206059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.219956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.221901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.222751 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1344/2617] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:19 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:57:19.223877 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.235504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1274/2618] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:57:19.237557 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c472-390c-4f7b-8156-3a8f27e673c2 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.243960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.245084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.245208 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.245497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.246242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.248120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.262274 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1345/2619] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:19.264525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.277017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c747-ae10-4a3e-834c-f865ab9546a9 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.283104 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.284313 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.284435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.284644 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] PATH_INFO: `/v3/projects/8fcbcf816a274161b88754954aa294e0/users/0b8636f2c05a483cae6646e9a76925b9/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.304548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcbcf816a274161b88754954aa294e0, user_id=0b8636f2c05a483cae6646e9a76925b9, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.308335 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.331481 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1275/2620] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:19 2022] PUT /identity/v3/projects/8fcbcf816a274161b88754954aa294e0/users/0b8636f2c05a483cae6646e9a76925b9/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:19.335668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.345953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de9d2-7c9c-41d9-9010-319c7310c8ed admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.356087 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:19.418434 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53554fa-6272-4809-8439-ec37a12df197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.419275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53554fa-6272-4809-8439-ec37a12df197 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.419642 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53554fa-6272-4809-8439-ec37a12df197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.420279 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53554fa-6272-4809-8439-ec37a12df197 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.420773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53554fa-6272-4809-8439-ec37a12df197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.422593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53554fa-6272-4809-8439-ec37a12df197 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.435318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1346/2621] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:19.438262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.451839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dba66-18db-44f3-8035-4c67d2a65797 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.456597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.457559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.457912 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.458255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] PATH_INFO: `/v3/projects/8fcbcf816a274161b88754954aa294e0/users/0b8636f2c05a483cae6646e9a76925b9/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.460328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcbcf816a274161b88754954aa294e0, user_id=0b8636f2c05a483cae6646e9a76925b9, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.463051 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.474365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1276/2622] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:19 2022] PUT /identity/v3/projects/8fcbcf816a274161b88754954aa294e0/users/0b8636f2c05a483cae6646e9a76925b9/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:19.484240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.484612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.484957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.513206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] MFA Rules not processed for user `0b8636f2c05a483cae6646e9a76925b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:19.514423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:19.582174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1347/2623] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:19.593244 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.595450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:19.606635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:19.678310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888885a-05e2-40f1-b600-3cbd7c380dee admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.679871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.681430 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:19.684019 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.684940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.685325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.685747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.719852 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.721449 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.741659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1277/2624] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:19.794815 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6595ec-622a-41bf-afc6-04099fa2106e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.801514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.802402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.803210 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.803523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] PATH_INFO: `/v3/projects/befcf496245147a3b81c33e9067a13c6` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.805222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=befcf496245147a3b81c33e9067a13c6)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:19.807902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:19.856752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:19.869071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecf839-b751-432c-9730-d98460f8a6c0 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:19.871162 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:19.884304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befcf496245147a3b81c33e9067a13c6', 'request_id': 'req-44d41c1c-635e-45bb-9f83-54f7cd2ff463'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:19.896924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befcf496245147a3b81c33e9067a13c6', 'request_id': 'req-44d41c1c-635e-45bb-9f83-54f7cd2ff463'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:19.904624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befcf496245147a3b81c33e9067a13c6', 'request_id': 'req-44d41c1c-635e-45bb-9f83-54f7cd2ff463'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:19.919619 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] The token cache is being invalidate because project befcf496245147a3b81c33e9067a13c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:19.920568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:19.921307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:19.938954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1348/2625] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:19 2022] DELETE /identity/v3/projects/befcf496245147a3b81c33e9067a13c6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:19.947714 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:19.948514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:19.949026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:19.949391 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:19.951895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:20.045445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:20.046984 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:20.097427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1278/2626] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:57:21.407192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:21.408749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:21.495615 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41c1c-635e-45bb-9f83-54f7cd2ff463 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:21.500283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:21.501156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:21.501441 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:21.501719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] PATH_INFO: `/v3/users/c3134832f2a647aab761da347f7e9fd4` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:21.516827 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3134832f2a647aab761da347f7e9fd4)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:21.518850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:21.569286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3134832f2a647aab761da347f7e9fd4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.577439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3134832f2a647aab761da347f7e9fd4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.578707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3134832f2a647aab761da347f7e9fd4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.587188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3134832f2a647aab761da347f7e9fd4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.601172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-85e8334b-8c13-497a-ad28-1a9e8b9cab4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3134832f2a647aab761da347f7e9fd4'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.607279 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1349/2627] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:21 2022] DELETE /identity/v3/users/c3134832f2a647aab761da347f7e9fd4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:21.809173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:21.821249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7e6b1-18dc-438f-b30d-a179e7ed06ab service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:21.882973 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:21.883916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:21.884135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:21.884415 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] PATH_INFO: `/v3/projects/8006d78bc1604611b3254b5efa451288` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:21.890959 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:21.896027 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8006d78bc1604611b3254b5efa451288)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:21.897979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:21.947767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8006d78bc1604611b3254b5efa451288', 'request_id': 'req-f79f7380-6476-4045-8662-df56c2cb67b9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.955698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8006d78bc1604611b3254b5efa451288', 'request_id': 'req-f79f7380-6476-4045-8662-df56c2cb67b9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.961958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8006d78bc1604611b3254b5efa451288', 'request_id': 'req-f79f7380-6476-4045-8662-df56c2cb67b9'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.973201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] The token cache is being invalidate because project 8006d78bc1604611b3254b5efa451288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:21.973487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.974122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f79f7380-6476-4045-8662-df56c2cb67b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:21.975668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1279/2628] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:21 2022] DELETE /identity/v3/projects/8006d78bc1604611b3254b5efa451288 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:21.980535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75c41-b99b-4e3d-826b-3ccd77b57186 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:21.980837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75c41-b99b-4e3d-826b-3ccd77b57186 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:21.981131 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75c41-b99b-4e3d-826b-3ccd77b57186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:21.998950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-43f75c41-b99b-4e3d-826b-3ccd77b57186 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:22.000147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-43f75c41-b99b-4e3d-826b-3ccd77b57186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:22.029502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:22.062311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1350/2629] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:22.070642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e56b0-87fc-46c6-8736-7be8f6aa67a4 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.071017 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e56b0-87fc-46c6-8736-7be8f6aa67a4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.071325 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e56b0-87fc-46c6-8736-7be8f6aa67a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.089385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-a82e56b0-87fc-46c6-8736-7be8f6aa67a4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:22.090586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a82e56b0-87fc-46c6-8736-7be8f6aa67a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:22.098553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1280/2630] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:22.102553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f75c41-b99b-4e3d-826b-3ccd77b57186 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.112952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f75c41-b99b-4e3d-826b-3ccd77b57186 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.117490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.118149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.118437 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.118720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.119544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:22.120019 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.121612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.133581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1351/2631] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:22.137847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e56b0-87fc-46c6-8736-7be8f6aa67a4 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.146939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e56b0-87fc-46c6-8736-7be8f6aa67a4 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.151618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.152271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.152561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.152847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.153533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.155463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.181289 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1281/2632] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:22.185095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.195540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90847-52ac-46bb-aa16-7a18f98c56e0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.250582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.251508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.251820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.252110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.253395 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.255389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.274653 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1352/2633] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:22.278633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.288731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085e44-415e-4649-864d-90dc85db5ccf admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.293592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.294252 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.294546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.294828 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.295589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.297175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.307453 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1282/2634] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:22.311112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.321521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581e3d2-c952-450b-ba02-6e095fb87a10 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.326046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f7362-8a24-4142-801b-5f5709982ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.326699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f7362-8a24-4142-801b-5f5709982ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.327025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f7362-8a24-4142-801b-5f5709982ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.327310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f7362-8a24-4142-801b-5f5709982ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.328029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f7362-8a24-4142-801b-5f5709982ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.329613 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f7362-8a24-4142-801b-5f5709982ca1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.340054 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1353/2635] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:22.343459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.353071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8185cd-deb9-4e56-8f7f-c30922919913 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.358206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.359115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.359403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.359684 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] PATH_INFO: `/v3/projects/6c64ce2146b543a4ba791d173307f555/users/31b69720b55e4fe592433c8c1427e0b6/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.374454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c64ce2146b543a4ba791d173307f555, user_id=31b69720b55e4fe592433c8c1427e0b6, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.377105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.390172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1283/2636] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:22 2022] PUT /identity/v3/projects/6c64ce2146b543a4ba791d173307f555/users/31b69720b55e4fe592433c8c1427e0b6/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:22.400211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1bc8-7615-4fb6-a0f5-f7d722d30094 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.400545 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1bc8-7615-4fb6-a0f5-f7d722d30094 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.400834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1bc8-7615-4fb6-a0f5-f7d722d30094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.427301 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-661a1bc8-7615-4fb6-a0f5-f7d722d30094 None None] MFA Rules not processed for user `31b69720b55e4fe592433c8c1427e0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:22.428489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-661a1bc8-7615-4fb6-a0f5-f7d722d30094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:22.491539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1354/2637] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:22.496010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.556720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebe14-82c3-4fde-924a-50f7b8536ba9 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.561553 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.562214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.562496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.562777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.563511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.565548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.589996 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1284/2638] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/projects => generated 361 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:22.595150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1bc8-7615-4fb6-a0f5-f7d722d30094 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.606304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1bc8-7615-4fb6-a0f5-f7d722d30094 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.632037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:22.663305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.663918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.664212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.664502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.665197 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.667426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.688084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1355/2639] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:22.692129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.705115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81d6be-df67-43b9-b263-531b1c619668 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.711710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.712414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.712700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.712982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.713715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.715344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.716844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:22.728497 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1285/2640] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:22.732663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.743318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe569f3e-0c04-4328-b393-5c725bc2f62c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.747969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.748856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.749144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.749426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] PATH_INFO: `/v3/projects/c62b8e92cd444b04b13bcf3c2e8bb6ed/users/7974183dd4b04f0f9dbf28374fadc089/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.764290 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62b8e92cd444b04b13bcf3c2e8bb6ed, user_id=7974183dd4b04f0f9dbf28374fadc089, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.766947 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.781198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1356/2641] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:22 2022] PUT /identity/v3/projects/c62b8e92cd444b04b13bcf3c2e8bb6ed/users/7974183dd4b04f0f9dbf28374fadc089/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:22.785748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.792793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.794504 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:22.796522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd1df-e689-48d2-9c07-715bdd5bc79e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.858090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.858783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.859087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.859377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.860113 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.861706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.862761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593740-14fd-4021-a7d3-44af823dbae0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.867452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.868336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.868654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.868937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] PATH_INFO: `/v3/users/22bf085848244aceaf04c4354b047374` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.870190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bf085848244aceaf04c4354b047374)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.872134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.875508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1286/2642] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:22.876502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:22.886025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3d42-8838-40ca-88b2-841fc26a4414 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:22.890782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b151b91-d3c9-4a64-bdd7-b0d92f6d190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:22.891698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b151b91-d3c9-4a64-bdd7-b0d92f6d190c admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.891990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b151b91-d3c9-4a64-bdd7-b0d92f6d190c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.892294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b151b91-d3c9-4a64-bdd7-b0d92f6d190c admin admin] PATH_INFO: `/v3/projects/c62b8e92cd444b04b13bcf3c2e8bb6ed/users/7974183dd4b04f0f9dbf28374fadc089/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.894805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b151b91-d3c9-4a64-bdd7-b0d92f6d190c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62b8e92cd444b04b13bcf3c2e8bb6ed, user_id=7974183dd4b04f0f9dbf28374fadc089, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:22.897518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b151b91-d3c9-4a64-bdd7-b0d92f6d190c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:22.908666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1287/2643] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:22 2022] PUT /identity/v3/projects/c62b8e92cd444b04b13bcf3c2e8bb6ed/users/7974183dd4b04f0f9dbf28374fadc089/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:22.920367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.920722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.921010 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.922360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bf085848244aceaf04c4354b047374'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:22.930104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bf085848244aceaf04c4354b047374'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:22.930801 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bf085848244aceaf04c4354b047374'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:22.937878 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bf085848244aceaf04c4354b047374'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:22.947567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] MFA Rules not processed for user `7974183dd4b04f0f9dbf28374fadc089`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:22.948794 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:22.950053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-375803c5-a57f-4f7a-bb44-010c07bd616b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bf085848244aceaf04c4354b047374'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:22.956946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1357/2644] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:22 2022] DELETE /identity/v3/users/22bf085848244aceaf04c4354b047374 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:22.961379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:22.961957 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:22.962251 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:22.980412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:22.981986 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:22.990784 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:23.017910 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1288/2645] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:23.029740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:23.031163 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:23.045534 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1358/2646] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:23.056503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:23.058055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:23.089491 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d4ff9-a50e-47a3-8193-34550f77bc34 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:23.106825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:23.122372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bcb16-562d-4cc3-83c4-56cc224d2299 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:23.126043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:23.126743 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:23.127065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:23.127348 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:23.140238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:23.141682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:23.142148 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:23.142811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:23.143134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:23.143944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:23.151860 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1359/2647] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:57:23.207812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:23.209192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:23.220270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1289/2648] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:57:23.293818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:23.304850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04473e1-f225-4c1f-b0ce-4ef67fc371cc service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:23.309043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:23.309841 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:23.310153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:23.310709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:23.312428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:23.374487 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:23.375965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:23.385779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1360/2649] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:23.439602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:23.441198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:23.472254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6e057-2db9-4441-97ac-82bcc4b804d3 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:23.477603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:23.478517 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:23.478809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:23.479162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] PATH_INFO: `/v3/projects/7d91db624f5346278f258d171988fd6d` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:23.480353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d91db624f5346278f258d171988fd6d)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:23.482377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:23.538630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d91db624f5346278f258d171988fd6d', 'request_id': 'req-0a0ac7ec-a380-45bb-a319-8ae751600cf6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.545946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d91db624f5346278f258d171988fd6d', 'request_id': 'req-0a0ac7ec-a380-45bb-a319-8ae751600cf6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.552468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d91db624f5346278f258d171988fd6d', 'request_id': 'req-0a0ac7ec-a380-45bb-a319-8ae751600cf6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.563777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] The token cache is being invalidate because project 7d91db624f5346278f258d171988fd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:23.564071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.564707 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.566487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1290/2650] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:23 2022] DELETE /identity/v3/projects/7d91db624f5346278f258d171988fd6d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:23.570571 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:23.581901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e11b3-9770-4201-bcc6-72da2246b059 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:23.631696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:23.638771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:23.639724 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:23.640018 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:23.640305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] PATH_INFO: `/v3/users/0b8636f2c05a483cae6646e9a76925b9` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:23.641497 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8636f2c05a483cae6646e9a76925b9)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:23.644033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:23.688114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8636f2c05a483cae6646e9a76925b9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.695134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8636f2c05a483cae6646e9a76925b9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.695764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8636f2c05a483cae6646e9a76925b9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.703057 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8636f2c05a483cae6646e9a76925b9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.716246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-18f52f28-fc1b-4aa4-af04-fe28ccce9e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8636f2c05a483cae6646e9a76925b9'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:23.723307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1361/2651] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:23 2022] DELETE /identity/v3/users/0b8636f2c05a483cae6646e9a76925b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:23.988744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:23.990367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:24.003487 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac7ec-a380-45bb-a319-8ae751600cf6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.052287 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:24.062998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.064085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.064381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.064665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] PATH_INFO: `/v3/projects/8fcbcf816a274161b88754954aa294e0` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.066360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcbcf816a274161b88754954aa294e0)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.068321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.113740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcbcf816a274161b88754954aa294e0', 'request_id': 'req-080bf157-e732-4521-9fbf-a6ef3eaee191'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:24.120889 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcbcf816a274161b88754954aa294e0', 'request_id': 'req-080bf157-e732-4521-9fbf-a6ef3eaee191'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:24.126783 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcbcf816a274161b88754954aa294e0', 'request_id': 'req-080bf157-e732-4521-9fbf-a6ef3eaee191'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:24.138166 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] The token cache is being invalidate because project 8fcbcf816a274161b88754954aa294e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:24.138461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:24.139370 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-080bf157-e732-4521-9fbf-a6ef3eaee191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:24.140932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1291/2652] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:23 2022] DELETE /identity/v3/projects/8fcbcf816a274161b88754954aa294e0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:24.146532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501116d8-1c33-4eb2-8f03-b6de855bc3c9 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.146832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501116d8-1c33-4eb2-8f03-b6de855bc3c9 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.147147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501116d8-1c33-4eb2-8f03-b6de855bc3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.164979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-501116d8-1c33-4eb2-8f03-b6de855bc3c9 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:24.166186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-501116d8-1c33-4eb2-8f03-b6de855bc3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:24.224345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1362/2653] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:24.232283 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1387-33d5-402b-bafb-0766abf802b8 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.232518 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1387-33d5-402b-bafb-0766abf802b8 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.232799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1387-33d5-402b-bafb-0766abf802b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.250261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-de5a1387-33d5-402b-bafb-0766abf802b8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:24.251483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-de5a1387-33d5-402b-bafb-0766abf802b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:24.259740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1292/2654] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:24.263851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501116d8-1c33-4eb2-8f03-b6de855bc3c9 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.274177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501116d8-1c33-4eb2-8f03-b6de855bc3c9 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.279160 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.279821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.280117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.280402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.281135 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:24.281455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.283095 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.295381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1363/2655] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:24.298994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a1387-33d5-402b-bafb-0766abf802b8 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.308446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a1387-33d5-402b-bafb-0766abf802b8 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.313026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.313669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.313953 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.314232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.314966 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.317380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.342310 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1293/2656] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:24 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:24.346623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.356963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0c14-df7a-4e69-9218-5bb152b504b8 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.411767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.412438 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.412729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.413012 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.413698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.415717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.423353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:24.437480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1364/2657] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:24 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:57:24.442109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.452275 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c1409-c98b-4abe-a9c7-d33e9e0c25f2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.456882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.457548 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.457838 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.458118 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.458844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.460463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.470841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1294/2658] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:24.474716 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.484648 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f733c-4d3d-4e84-a055-1e6f5f3b168e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.489757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a953b12-1da4-407c-9245-98f5216a43b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.490445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a953b12-1da4-407c-9245-98f5216a43b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.490737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a953b12-1da4-407c-9245-98f5216a43b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.491056 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a953b12-1da4-407c-9245-98f5216a43b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.491787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a953b12-1da4-407c-9245-98f5216a43b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.493422 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a953b12-1da4-407c-9245-98f5216a43b9 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.504239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1365/2659] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:24.507866 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.517692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28f21-49ee-4692-835d-6d7cd88e7bc1 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.522338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.523248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.523541 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.523825 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] PATH_INFO: `/v3/projects/d52d13c446734f49ae487d18230ce9e7/users/9d0aaf3d5c3240b5adea4700e1915db7/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.540112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52d13c446734f49ae487d18230ce9e7, user_id=9d0aaf3d5c3240b5adea4700e1915db7, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.543018 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.557025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1295/2660] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:24 2022] PUT /identity/v3/projects/d52d13c446734f49ae487d18230ce9e7/users/9d0aaf3d5c3240b5adea4700e1915db7/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:24.568859 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3198-0925-4e77-9064-cbcef8f14193 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.569180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3198-0925-4e77-9064-cbcef8f14193 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.569463 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3198-0925-4e77-9064-cbcef8f14193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.599317 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a4be3198-0925-4e77-9064-cbcef8f14193 None None] MFA Rules not processed for user `9d0aaf3d5c3240b5adea4700e1915db7`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:24.600585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a4be3198-0925-4e77-9064-cbcef8f14193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:24.665459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1366/2661] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:24.670337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.743963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285ba2-da9d-4518-9090-d47fa674f39d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.748791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.749464 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.749752 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.750032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.750744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.752748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.779668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1296/2662] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:24 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:24.784646 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3198-0925-4e77-9064-cbcef8f14193 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.795937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3198-0925-4e77-9064-cbcef8f14193 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.878198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.879007 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.879428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.879834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.881058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.883180 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.906766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1367/2663] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:24 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:24.920140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.920140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:24.924650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48089b33-eb06-4601-a036-1be53bdbd9ef admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.931726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.932623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.933023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.933471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.934231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.935899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.947154 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1297/2664] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:24.951397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:24.961324 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4381-174e-411c-bc2c-3b1562d4c761 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:24.965851 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:24.966730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:24.967049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:24.967327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] PATH_INFO: `/v3/projects/5f15528df5a542aebadb5b2b95ee65f0/users/111bd47ffc6e431e8661154b2717d68e/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:24.983228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f15528df5a542aebadb5b2b95ee65f0, user_id=111bd47ffc6e431e8661154b2717d68e, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:24.986260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:24.998997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1368/2665] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:24 2022] PUT /identity/v3/projects/5f15528df5a542aebadb5b2b95ee65f0/users/111bd47ffc6e431e8661154b2717d68e/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:25.002939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:25.013022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb446b1-c9c4-4ea7-8141-8e635fc4962e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:25.070871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ac458-5f7a-4bc3-b9ce-e16a25709385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:25.071583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac458-5f7a-4bc3-b9ce-e16a25709385 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:25.071873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac458-5f7a-4bc3-b9ce-e16a25709385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:25.072156 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac458-5f7a-4bc3-b9ce-e16a25709385 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:25.072887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ac458-5f7a-4bc3-b9ce-e16a25709385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:25.074475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ac458-5f7a-4bc3-b9ce-e16a25709385 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:25.084722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1298/2666] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:25.088953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:25.099897 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177b77d-5c4f-422b-972b-bc9caf012836 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:25.104425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:25.105305 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:25.105596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:25.105904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] PATH_INFO: `/v3/projects/5f15528df5a542aebadb5b2b95ee65f0/users/111bd47ffc6e431e8661154b2717d68e/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:25.107887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f15528df5a542aebadb5b2b95ee65f0, user_id=111bd47ffc6e431e8661154b2717d68e, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:25.110519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:25.120556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1369/2667] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:25 2022] PUT /identity/v3/projects/5f15528df5a542aebadb5b2b95ee65f0/users/111bd47ffc6e431e8661154b2717d68e/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:25.130392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443ad3-da33-4b15-bedd-e13609b302e1 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:25.130756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443ad3-da33-4b15-bedd-e13609b302e1 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:25.131162 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443ad3-da33-4b15-bedd-e13609b302e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:25.156801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e4443ad3-da33-4b15-bedd-e13609b302e1 None None] MFA Rules not processed for user `111bd47ffc6e431e8661154b2717d68e`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:25.158037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e4443ad3-da33-4b15-bedd-e13609b302e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:25.224564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1299/2668] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:25.235134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:25.236884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:25.262218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:25.294482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d586-d77e-40bc-98c5-beff5b603997 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:25.298096 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d7523-0dc1-4527-b076-e5f67be5cd89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:25.298736 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d7523-0dc1-4527-b076-e5f67be5cd89 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:25.299055 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d7523-0dc1-4527-b076-e5f67be5cd89 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:25.299342 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d7523-0dc1-4527-b076-e5f67be5cd89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:25.308345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d7523-0dc1-4527-b076-e5f67be5cd89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:25.309793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d7523-0dc1-4527-b076-e5f67be5cd89 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:25.319347 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1370/2669] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:25.442721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443ad3-da33-4b15-bedd-e13609b302e1 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:25.504980 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443ad3-da33-4b15-bedd-e13609b302e1 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:25.509440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:25.510322 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:25.510612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:25.510891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] PATH_INFO: `/v3/users/9d0aaf3d5c3240b5adea4700e1915db7` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:25.512108 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0aaf3d5c3240b5adea4700e1915db7)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:25.514031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:25.531970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:25.561810 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0aaf3d5c3240b5adea4700e1915db7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:25.569050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0aaf3d5c3240b5adea4700e1915db7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:25.575850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0aaf3d5c3240b5adea4700e1915db7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:25.576421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0aaf3d5c3240b5adea4700e1915db7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:25.577026 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0aaf3d5c3240b5adea4700e1915db7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:25.594965 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1300/2670] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:25 2022] DELETE /identity/v3/users/9d0aaf3d5c3240b5adea4700e1915db7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:25.599477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:25.599958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:25.600082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:25.617569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:25.618753 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:25.677053 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1371/2671] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:25.686513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:25.687933 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:25.744944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55964-46ce-4387-82f6-752162159b87 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:25.748556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:25.749204 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:25.749490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:25.749770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:25.759258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:25.760626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:25.770473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1301/2672] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:26.039528 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:26.041076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:26.056419 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582a9ad-30ab-4eb1-920b-d3292a598aae None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:26.062083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:26.063013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:26.063308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:26.063599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] PATH_INFO: `/v3/projects/d52d13c446734f49ae487d18230ce9e7` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:26.064961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52d13c446734f49ae487d18230ce9e7)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:26.067470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:26.118402 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52d13c446734f49ae487d18230ce9e7', 'request_id': 'req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.127421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52d13c446734f49ae487d18230ce9e7', 'request_id': 'req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.134687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52d13c446734f49ae487d18230ce9e7', 'request_id': 'req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.150828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] The token cache is being invalidate because project d52d13c446734f49ae487d18230ce9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:26.151234 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.152309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.153873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1372/2673] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:26 2022] DELETE /identity/v3/projects/d52d13c446734f49ae487d18230ce9e7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:26.157899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:26.167978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f38c9-7463-4c03-825a-77fa0ca0d015 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:26.227086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:26.227975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:26.228269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:26.228559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] PATH_INFO: `/v3/users/111bd47ffc6e431e8661154b2717d68e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:26.229746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=111bd47ffc6e431e8661154b2717d68e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:26.231730 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:26.275525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:26.282381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111bd47ffc6e431e8661154b2717d68e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.293226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111bd47ffc6e431e8661154b2717d68e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.302110 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111bd47ffc6e431e8661154b2717d68e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.302731 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111bd47ffc6e431e8661154b2717d68e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.303385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-bb02a078-8733-4363-a97b-1862b49d8fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111bd47ffc6e431e8661154b2717d68e'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.321261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1302/2674] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:26 2022] DELETE /identity/v3/users/111bd47ffc6e431e8661154b2717d68e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:26.603549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:26.605058 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:26.618206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d67f8f-3a9e-4678-94c8-6a1d715ecaea admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:26.665481 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:26.678621 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:26.679525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:26.679818 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:26.680102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] PATH_INFO: `/v3/projects/5f15528df5a542aebadb5b2b95ee65f0` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:26.681284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f15528df5a542aebadb5b2b95ee65f0)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:26.683221 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:26.728551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f15528df5a542aebadb5b2b95ee65f0', 'request_id': 'req-92fffe8d-61f0-451e-8c3d-7631f6b520cb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.735835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f15528df5a542aebadb5b2b95ee65f0', 'request_id': 'req-92fffe8d-61f0-451e-8c3d-7631f6b520cb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.741654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f15528df5a542aebadb5b2b95ee65f0', 'request_id': 'req-92fffe8d-61f0-451e-8c3d-7631f6b520cb'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.752750 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] The token cache is being invalidate because project 5f15528df5a542aebadb5b2b95ee65f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:26.753045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.753708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-92fffe8d-61f0-451e-8c3d-7631f6b520cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:26.755294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1373/2675] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:26 2022] DELETE /identity/v3/projects/5f15528df5a542aebadb5b2b95ee65f0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:26.760740 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aff8e8-b058-4a06-91eb-273cfc4ca0df None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:26.761060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aff8e8-b058-4a06-91eb-273cfc4ca0df None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:26.761347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aff8e8-b058-4a06-91eb-273cfc4ca0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:26.778955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-49aff8e8-b058-4a06-91eb-273cfc4ca0df None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:26.780143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-49aff8e8-b058-4a06-91eb-273cfc4ca0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:26.837345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1303/2676] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:26.844592 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82c88-c07c-4cbc-8fce-dcf7de92d372 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:26.844886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82c88-c07c-4cbc-8fce-dcf7de92d372 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:26.845171 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82c88-c07c-4cbc-8fce-dcf7de92d372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:26.863779 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-15b82c88-c07c-4cbc-8fce-dcf7de92d372 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:26.864962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-15b82c88-c07c-4cbc-8fce-dcf7de92d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:26.872709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1374/2677] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:26.876715 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aff8e8-b058-4a06-91eb-273cfc4ca0df None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:26.886146 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aff8e8-b058-4a06-91eb-273cfc4ca0df None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:26.890904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:26.891622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:26.891923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:26.892199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:26.892937 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:26.893249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:26.895372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:26.907037 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1304/2678] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:26.911664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b82c88-c07c-4cbc-8fce-dcf7de92d372 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:26.921159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b82c88-c07c-4cbc-8fce-dcf7de92d372 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:26.925780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:26.926425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:26.926715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:26.927037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:26.927740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:26.929627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:26.957420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1375/2679] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:26 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:26.959032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:26.968664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf496dd-3cf6-489f-9dd1-37d4081b0f2f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.023509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.024179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.024471 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.024758 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.025456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.027428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.047505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1305/2680] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:26 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:57:27.051540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.062188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ccb4-5c61-4635-a076-d759f250a77e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.067496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.068167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.068461 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.068747 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.069485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.071122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.081787 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1376/2681] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:27.086349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.096189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7747e24-d2bb-49a7-ab85-5ab0effdeba2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.100655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144f78-6ee9-4c44-9c0d-20c6d6583385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.101314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144f78-6ee9-4c44-9c0d-20c6d6583385 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.101600 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144f78-6ee9-4c44-9c0d-20c6d6583385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.101888 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144f78-6ee9-4c44-9c0d-20c6d6583385 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.102879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d144f78-6ee9-4c44-9c0d-20c6d6583385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.104496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d144f78-6ee9-4c44-9c0d-20c6d6583385 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.114501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1306/2682] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:27.118271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.128045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96159a-4171-45be-8b37-2455e1030a46 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.133120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.134000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.134286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.134572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] PATH_INFO: `/v3/projects/8652ea8ee3d243a1853a7fd88160b586/users/e101957e22c643499d4690947dc97a89/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.149518 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8652ea8ee3d243a1853a7fd88160b586, user_id=e101957e22c643499d4690947dc97a89, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.152190 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.165420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1377/2683] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:27 2022] PUT /identity/v3/projects/8652ea8ee3d243a1853a7fd88160b586/users/e101957e22c643499d4690947dc97a89/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:27.176724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2506d4-7241-4fae-aa9a-f4b7dd07eb82 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.177214 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2506d4-7241-4fae-aa9a-f4b7dd07eb82 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.177332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2506d4-7241-4fae-aa9a-f4b7dd07eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.203336 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-dd2506d4-7241-4fae-aa9a-f4b7dd07eb82 None None] MFA Rules not processed for user `e101957e22c643499d4690947dc97a89`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:27.204525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-dd2506d4-7241-4fae-aa9a-f4b7dd07eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:27.213994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:27.268323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1307/2684] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:27.273318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.333888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d1977-7416-4072-b7e4-801235625243 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.338493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.339179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.339468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.339749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.340446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.342328 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.361198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:27.371077 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1378/2685] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:27 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:27.372787 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2506d4-7241-4fae-aa9a-f4b7dd07eb82 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.384085 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2506d4-7241-4fae-aa9a-f4b7dd07eb82 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.439397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.440072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.440364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.440649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.442045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.444942 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.466748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1308/2686] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:27 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:27.470824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.481412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd98c1-a46d-45d3-bf9a-b828cf089ffe admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.486029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.486702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.487031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.487319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.488583 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.490192 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.500664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1379/2687] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:27.505536 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.516172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bececf49-7528-4bbe-8a47-b15952c66450 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.520686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.521564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.521848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.522127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] PATH_INFO: `/v3/projects/3f1b605bebfc46998e948f98e4bb6939/users/8a9f3b1c388947fa8177598f4e4f3f46/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.536333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1b605bebfc46998e948f98e4bb6939, user_id=8a9f3b1c388947fa8177598f4e4f3f46, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.538977 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.552405 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1309/2688] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:27 2022] PUT /identity/v3/projects/3f1b605bebfc46998e948f98e4bb6939/users/8a9f3b1c388947fa8177598f4e4f3f46/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:27.556737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.568060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aff3e-f15d-4d36-b46b-d778cf9acea0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.632511 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657b431-1626-4818-a48d-0c47582518b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.633194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657b431-1626-4818-a48d-0c47582518b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.633485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657b431-1626-4818-a48d-0c47582518b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.633770 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657b431-1626-4818-a48d-0c47582518b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.634505 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657b431-1626-4818-a48d-0c47582518b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.636224 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657b431-1626-4818-a48d-0c47582518b1 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.645949 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1380/2689] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:27.650184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.660285 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b96a1-a4ef-4a99-b3bf-3fcdfabfe0f1 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.664843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.665721 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.666006 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.666288 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] PATH_INFO: `/v3/projects/3f1b605bebfc46998e948f98e4bb6939/users/8a9f3b1c388947fa8177598f4e4f3f46/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.668508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1b605bebfc46998e948f98e4bb6939, user_id=8a9f3b1c388947fa8177598f4e4f3f46, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.671143 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.681512 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1310/2690] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:27 2022] PUT /identity/v3/projects/3f1b605bebfc46998e948f98e4bb6939/users/8a9f3b1c388947fa8177598f4e4f3f46/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:27.692186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c392e9-2035-413a-8a2e-1691788d06ee None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.692479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c392e9-2035-413a-8a2e-1691788d06ee None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.692760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c392e9-2035-413a-8a2e-1691788d06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.718714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-48c392e9-2035-413a-8a2e-1691788d06ee None None] MFA Rules not processed for user `8a9f3b1c388947fa8177598f4e4f3f46`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:27.719942 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-48c392e9-2035-413a-8a2e-1691788d06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:27.787177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1381/2691] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:27.798199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:27.799873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:27.856737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e3f33-331e-4d3b-9cf4-767a8323238b admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:27.860345 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:27.860981 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:27.861267 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:27.861547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:27.878117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:27.918122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:27.919579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:27.928808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1311/2692] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:34.142176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c392e9-2035-413a-8a2e-1691788d06ee None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:34.152453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c392e9-2035-413a-8a2e-1691788d06ee None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:34.156049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9720c-c2e5-4c64-86bd-4f260a579204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:34.156686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9720c-c2e5-4c64-86bd-4f260a579204 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:34.156975 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9720c-c2e5-4c64-86bd-4f260a579204 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:34.157258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9720c-c2e5-4c64-86bd-4f260a579204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:34.167304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9720c-c2e5-4c64-86bd-4f260a579204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:34.168686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9720c-c2e5-4c64-86bd-4f260a579204 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:34.178009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1382/2693] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:34.636321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:34.637745 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:34.704223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d417-3c47-4470-b65d-d30da5bbedc3 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:34.709316 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:34.710205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:34.710490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:34.710769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] PATH_INFO: `/v3/users/31b69720b55e4fe592433c8c1427e0b6` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:34.711996 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b69720b55e4fe592433c8c1427e0b6)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:34.713927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:34.758936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b69720b55e4fe592433c8c1427e0b6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:34.766153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b69720b55e4fe592433c8c1427e0b6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:34.773356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b69720b55e4fe592433c8c1427e0b6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:34.774050 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b69720b55e4fe592433c8c1427e0b6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:34.774661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b69720b55e4fe592433c8c1427e0b6'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:34.791589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1312/2694] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:34 2022] DELETE /identity/v3/users/31b69720b55e4fe592433c8c1427e0b6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:34.796312 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:34.796607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:34.796889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:34.814349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:34.815560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:34.863683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:34.874762 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1383/2695] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:34.884841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:34.886255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:34.928033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:34.945320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc18ab-d66d-4179-af8d-485ba936638f admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:34.948972 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:34.949656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:34.949962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:34.950230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:34.959334 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:34.960728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:34.970084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1313/2696] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:35.234256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:35.235780 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:35.248174 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa54330-7a04-4a7f-a640-f5a39221f754 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:35.253119 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:35.253997 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:35.254281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:35.254560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] PATH_INFO: `/v3/projects/6c64ce2146b543a4ba791d173307f555` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:35.255781 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c64ce2146b543a4ba791d173307f555)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:35.257690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:35.304143 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c64ce2146b543a4ba791d173307f555', 'request_id': 'req-27eebe19-d870-4dc1-9fa1-89a81326515b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.311010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c64ce2146b543a4ba791d173307f555', 'request_id': 'req-27eebe19-d870-4dc1-9fa1-89a81326515b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.317203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c64ce2146b543a4ba791d173307f555', 'request_id': 'req-27eebe19-d870-4dc1-9fa1-89a81326515b'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.328014 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] The token cache is being invalidate because project 6c64ce2146b543a4ba791d173307f555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:35.328307 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.328978 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.330608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1384/2697] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:35 2022] DELETE /identity/v3/projects/6c64ce2146b543a4ba791d173307f555 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:35.334547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:35.343975 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18638b-55ee-40eb-9913-ea55c0ed3e27 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:35.400362 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:35.401248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:35.401540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:35.401821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] PATH_INFO: `/v3/users/7974183dd4b04f0f9dbf28374fadc089` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:35.403033 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7974183dd4b04f0f9dbf28374fadc089)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:35.404939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:35.450232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7974183dd4b04f0f9dbf28374fadc089'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.456947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7974183dd4b04f0f9dbf28374fadc089'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.465055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7974183dd4b04f0f9dbf28374fadc089'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.465670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7974183dd4b04f0f9dbf28374fadc089'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.466249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-3870e78d-5527-4e14-94a4-d874d0667257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7974183dd4b04f0f9dbf28374fadc089'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.484671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1314/2698] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:35 2022] DELETE /identity/v3/users/7974183dd4b04f0f9dbf28374fadc089 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:35.776122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:35.777814 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:35.796473 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eebe19-d870-4dc1-9fa1-89a81326515b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:35.855009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:35.855887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:35.856184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:35.856468 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] PATH_INFO: `/v3/projects/c62b8e92cd444b04b13bcf3c2e8bb6ed` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:35.857657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62b8e92cd444b04b13bcf3c2e8bb6ed)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:35.859614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:35.906242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62b8e92cd444b04b13bcf3c2e8bb6ed', 'request_id': 'req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.913742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62b8e92cd444b04b13bcf3c2e8bb6ed', 'request_id': 'req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.919554 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62b8e92cd444b04b13bcf3c2e8bb6ed', 'request_id': 'req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.930366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] The token cache is being invalidate because project c62b8e92cd444b04b13bcf3c2e8bb6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:35.930657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.931324 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c1aa43b0-c8c7-48aa-8f26-44ba2a515bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:35.932905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1385/2699] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:35 2022] DELETE /identity/v3/projects/c62b8e92cd444b04b13bcf3c2e8bb6ed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:35.938355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e91af-24b8-4442-9de3-a51910bd1827 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:35.938853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e91af-24b8-4442-9de3-a51910bd1827 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:35.939070 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e91af-24b8-4442-9de3-a51910bd1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:35.957338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-0e2e91af-24b8-4442-9de3-a51910bd1827 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:35.959265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0e2e91af-24b8-4442-9de3-a51910bd1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:36.012072 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:36.023279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1315/2700] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:36.031241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae92da1-be38-4b3e-a5b0-e72b14f98b89 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.031539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae92da1-be38-4b3e-a5b0-e72b14f98b89 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.031822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae92da1-be38-4b3e-a5b0-e72b14f98b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.051186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-3ae92da1-be38-4b3e-a5b0-e72b14f98b89 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:36.052379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3ae92da1-be38-4b3e-a5b0-e72b14f98b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:36.061203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1386/2701] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:36.065762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e91af-24b8-4442-9de3-a51910bd1827 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.087780 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e91af-24b8-4442-9de3-a51910bd1827 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.092489 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.093164 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.093457 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.093773 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.094567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:36.094999 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.096665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.108623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1316/2702] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:36.113137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae92da1-be38-4b3e-a5b0-e72b14f98b89 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.118846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:36.122664 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae92da1-be38-4b3e-a5b0-e72b14f98b89 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.128809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.130148 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.130820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.131198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.132085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.134084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.163576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1387/2703] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:36 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:36.168031 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.177821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64254-7b17-4ff8-ad10-bcfcae486ffb admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.234514 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.235226 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.235523 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.235813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.236516 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.238427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.258330 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1317/2704] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:36 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:36.262285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.273283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12124b23-dd34-458c-9e41-fbea816d6518 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.277821 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.278508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.278802 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.279121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.279974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.281599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.292099 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1388/2705] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:36.295978 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.306220 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1746-d45e-4feb-aad3-b54a28443065 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.310862 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9c902-2023-487e-969b-a7a5d6d87974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.311554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9c902-2023-487e-969b-a7a5d6d87974 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.311848 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9c902-2023-487e-969b-a7a5d6d87974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.312135 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9c902-2023-487e-969b-a7a5d6d87974 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.312982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9c902-2023-487e-969b-a7a5d6d87974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.314906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9c902-2023-487e-969b-a7a5d6d87974 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.326105 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1318/2706] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:36.329480 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.339292 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc92b6-eee9-408f-82cb-ccef3fab9295 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.343852 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.344732 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.345023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.345310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] PATH_INFO: `/v3/projects/d3eabc83dbb94ba685b857d803872247/users/b2160f03bec742e1b5ed020e92a1e6e8/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.359482 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3eabc83dbb94ba685b857d803872247, user_id=b2160f03bec742e1b5ed020e92a1e6e8, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.362113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.375708 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1389/2707] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:36 2022] PUT /identity/v3/projects/d3eabc83dbb94ba685b857d803872247/users/b2160f03bec742e1b5ed020e92a1e6e8/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:36.387893 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bafb5-2c49-4b21-96a4-d89b5578be02 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.388191 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bafb5-2c49-4b21-96a4-d89b5578be02 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.388479 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bafb5-2c49-4b21-96a4-d89b5578be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.414389 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-555bafb5-2c49-4b21-96a4-d89b5578be02 None None] MFA Rules not processed for user `b2160f03bec742e1b5ed020e92a1e6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:36.415661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-555bafb5-2c49-4b21-96a4-d89b5578be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:36.479413 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1319/2708] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:36.483935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.544950 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc819ff0-7000-4dfe-839d-8c1cc4f0b130 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.549389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.550045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.550336 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.550620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.551351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.553766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.578196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1390/2709] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:36 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:36.582346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bafb5-2c49-4b21-96a4-d89b5578be02 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.593528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bafb5-2c49-4b21-96a4-d89b5578be02 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.641887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:36.649583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.650263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.650551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.650830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.651546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.653445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.673000 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1320/2710] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:36 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:36.678654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.688748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deeb07-b1e1-4bf8-b946-f3a0a63cb17a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.693337 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.693998 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.694288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.694578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.695358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.696960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.708431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1391/2711] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:36.712623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.722737 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c8a1-10d7-477f-86aa-c3305a1cb5c6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.727919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.729198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.729522 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.729802 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] PATH_INFO: `/v3/projects/995dc32ba1114cb6b7c97f23d13bc940/users/4ca2ccbed9ad4600b028b844c00bffd7/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.744655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995dc32ba1114cb6b7c97f23d13bc940, user_id=4ca2ccbed9ad4600b028b844c00bffd7, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.747317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.759998 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1321/2712] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:36 2022] PUT /identity/v3/projects/995dc32ba1114cb6b7c97f23d13bc940/users/4ca2ccbed9ad4600b028b844c00bffd7/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:36.763921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.774193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6300f9-8119-433e-b1ba-553d8f7ff132 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.831566 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ff179-3586-4ab5-942e-1880e2d49625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.832242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff179-3586-4ab5-942e-1880e2d49625 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.832531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff179-3586-4ab5-942e-1880e2d49625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.832809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff179-3586-4ab5-942e-1880e2d49625 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.833540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ff179-3586-4ab5-942e-1880e2d49625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.835216 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ff179-3586-4ab5-942e-1880e2d49625 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.845466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1392/2713] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:36.850253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:36.860767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1332746-bbf8-4955-94da-acbff6ceac09 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:36.867076 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:36.867995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.868284 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.868570 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] PATH_INFO: `/v3/projects/995dc32ba1114cb6b7c97f23d13bc940/users/4ca2ccbed9ad4600b028b844c00bffd7/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.870797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995dc32ba1114cb6b7c97f23d13bc940, user_id=4ca2ccbed9ad4600b028b844c00bffd7, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:36.873459 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:36.884734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1322/2714] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:36 2022] PUT /identity/v3/projects/995dc32ba1114cb6b7c97f23d13bc940/users/4ca2ccbed9ad4600b028b844c00bffd7/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:36.895142 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:36.895541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:36.895836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:36.922976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] MFA Rules not processed for user `4ca2ccbed9ad4600b028b844c00bffd7`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:36.924158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:36.933854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:36.996250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1393/2715] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:57:37.006887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:37.008604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:37.066813 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f1b71-4371-493b-a5f0-376acfd46791 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:37.070509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f52f17-bbe8-4cd3-8069-8be404cdbc68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:37.071183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f52f17-bbe8-4cd3-8069-8be404cdbc68 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:37.071484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f52f17-bbe8-4cd3-8069-8be404cdbc68 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:37.071766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f52f17-bbe8-4cd3-8069-8be404cdbc68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:37.129979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f52f17-bbe8-4cd3-8069-8be404cdbc68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:37.131440 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f52f17-bbe8-4cd3-8069-8be404cdbc68 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:37.140099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1323/2716] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:39.060542 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:39.061954 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:39.124719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026617ac-d0c6-4553-9aee-6f504513a396 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:39.129140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:39.130489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:39.130772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:39.131076 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] PATH_INFO: `/v3/users/e101957e22c643499d4690947dc97a89` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:39.132267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e101957e22c643499d4690947dc97a89)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:39.134168 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:39.178661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e101957e22c643499d4690947dc97a89'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.185344 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e101957e22c643499d4690947dc97a89'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.186035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e101957e22c643499d4690947dc97a89'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.193581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e101957e22c643499d4690947dc97a89'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.205110 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e101957e22c643499d4690947dc97a89'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.211490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1394/2717] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:39 2022] DELETE /identity/v3/users/e101957e22c643499d4690947dc97a89 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:39.215920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:39.216379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:39.216493 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:39.232703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:39.233891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:39.290695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1324/2718] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:39.300489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:39.302396 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:39.328971 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:39.365060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852d15e-91ea-4b11-bc41-582fcc271597 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:39.368894 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:39.369556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:39.369846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:39.370129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:39.379426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:39.381516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:39.390901 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1395/2719] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:39.658340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:39.659801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:39.667800 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:39.673925 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249da75-9a86-4a1c-8407-536b40db06b5 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:39.680757 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:39.681716 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:39.682001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:39.682270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] PATH_INFO: `/v3/projects/8652ea8ee3d243a1853a7fd88160b586` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:39.683504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8652ea8ee3d243a1853a7fd88160b586)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:39.685381 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:39.731184 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8652ea8ee3d243a1853a7fd88160b586', 'request_id': 'req-45a15eb7-b5d5-4ac9-b84f-da735f058891'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.738473 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8652ea8ee3d243a1853a7fd88160b586', 'request_id': 'req-45a15eb7-b5d5-4ac9-b84f-da735f058891'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.744649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8652ea8ee3d243a1853a7fd88160b586', 'request_id': 'req-45a15eb7-b5d5-4ac9-b84f-da735f058891'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.755317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] The token cache is being invalidate because project 8652ea8ee3d243a1853a7fd88160b586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:39.755602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.756231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.757756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1325/2720] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:39 2022] DELETE /identity/v3/projects/8652ea8ee3d243a1853a7fd88160b586 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:39.761684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:39.771682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4fec-c6ba-4369-80b8-c158caef54ea service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:39.827211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:39.828092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:39.828382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:39.828665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] PATH_INFO: `/v3/users/8a9f3b1c388947fa8177598f4e4f3f46` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:39.829834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9f3b1c388947fa8177598f4e4f3f46)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:39.831838 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:39.876442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9f3b1c388947fa8177598f4e4f3f46'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.883614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9f3b1c388947fa8177598f4e4f3f46'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.884302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9f3b1c388947fa8177598f4e4f3f46'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.891156 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9f3b1c388947fa8177598f4e4f3f46'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.902712 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-286579fb-f30e-429f-95e1-43ab35f63b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9f3b1c388947fa8177598f4e4f3f46'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:39.908601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1396/2721] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:57:39 2022] DELETE /identity/v3/users/8a9f3b1c388947fa8177598f4e4f3f46 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:40.177007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.178930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:40.195756 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15eb7-b5d5-4ac9-b84f-da735f058891 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.251396 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.252271 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.252561 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.252843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] PATH_INFO: `/v3/projects/3f1b605bebfc46998e948f98e4bb6939` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.254008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1b605bebfc46998e948f98e4bb6939)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.255950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.302186 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1b605bebfc46998e948f98e4bb6939', 'request_id': 'req-c8976bfa-0d5a-45e3-bbb5-0535085cd423'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:40.309198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1b605bebfc46998e948f98e4bb6939', 'request_id': 'req-c8976bfa-0d5a-45e3-bbb5-0535085cd423'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:40.314816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1b605bebfc46998e948f98e4bb6939', 'request_id': 'req-c8976bfa-0d5a-45e3-bbb5-0535085cd423'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:40.325505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] The token cache is being invalidate because project 3f1b605bebfc46998e948f98e4bb6939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:57:40.325792 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:40.326419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-c8976bfa-0d5a-45e3-bbb5-0535085cd423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:57:40.327968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1326/2722] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:57:40 2022] DELETE /identity/v3/projects/3f1b605bebfc46998e948f98e4bb6939 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:57:40.334318 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86ef89-3464-4755-a381-fbdff9451547 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.334792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86ef89-3464-4755-a381-fbdff9451547 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.334955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86ef89-3464-4755-a381-fbdff9451547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.354047 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-df86ef89-3464-4755-a381-fbdff9451547 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:40.355390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-df86ef89-3464-4755-a381-fbdff9451547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:40.395140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:40.415665 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1397/2723] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:40.425054 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998bcb-8078-458b-8a2e-8af55f0e72fa None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.425351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998bcb-8078-458b-8a2e-8af55f0e72fa None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.425640 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6998bcb-8078-458b-8a2e-8af55f0e72fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.443870 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-b6998bcb-8078-458b-8a2e-8af55f0e72fa None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:40.445094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-b6998bcb-8078-458b-8a2e-8af55f0e72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:40.452974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1327/2724] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:40.456945 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86ef89-3464-4755-a381-fbdff9451547 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.467085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86ef89-3464-4755-a381-fbdff9451547 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.471623 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.472279 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.472567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.472845 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.473624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:57:40.473930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.475548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.486713 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1398/2725] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:57:40.490854 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6998bcb-8078-458b-8a2e-8af55f0e72fa None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.499962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6998bcb-8078-458b-8a2e-8af55f0e72fa None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.504540 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.505678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.505969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.506253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.506963 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.508851 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.512801 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:40.536777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1328/2726] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:57:40 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:57:40.540727 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.550902 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc07ed-a3ef-4ee7-9827-d9504c85645e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.607345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.607956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.608249 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.608532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.609240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.611179 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.630721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1399/2727] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:57:40 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:57:40.634683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.644837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690270-ecaa-43b9-9884-9f574c68cbb1 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.650097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.650759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.651093 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.651382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.652112 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.653703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.663970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1329/2728] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:40.668068 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.678157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f412-a93b-4034-bd7d-6e628f84cc96 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.682788 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277d35-8e1e-4c9e-966b-7e1bf92c56ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.683529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277d35-8e1e-4c9e-966b-7e1bf92c56ce admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.683831 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277d35-8e1e-4c9e-966b-7e1bf92c56ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.684111 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277d35-8e1e-4c9e-966b-7e1bf92c56ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.684836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95277d35-8e1e-4c9e-966b-7e1bf92c56ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.686415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95277d35-8e1e-4c9e-966b-7e1bf92c56ce admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.698777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1400/2729] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:57:40.702771 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.713416 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d471-5d27-4ec1-b6a4-2683ee2fb656 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.718203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.719126 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.719411 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.719687 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] PATH_INFO: `/v3/projects/ffa4759b05a1433a83a639b44935cea8/users/5ab3217ba84a45d0ba14039112ba9967/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.733993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa4759b05a1433a83a639b44935cea8, user_id=5ab3217ba84a45d0ba14039112ba9967, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.736698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.749544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1330/2730] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:57:40 2022] PUT /identity/v3/projects/ffa4759b05a1433a83a639b44935cea8/users/5ab3217ba84a45d0ba14039112ba9967/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:57:40.812415 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.812709 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.812995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.839491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] MFA Rules not processed for user `5ab3217ba84a45d0ba14039112ba9967`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:57:40.840696 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:40.902737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1401/2731] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:57:40.914041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:40.915797 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:40.972048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a87c7-5aab-459c-aece-b77b9af2108a admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:40.975657 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:40.976302 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:40.976593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:40.976877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:40.985088 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:40.986511 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:40.996025 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1331/2732] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:42.751562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:57:42.752984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:42.764684 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689cf54-ac08-42b4-881f-b93c77a7b8ee None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:57:42.768516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625729a7-0185-4d3e-85c9-575460ecb493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:57:42.769159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625729a7-0185-4d3e-85c9-575460ecb493 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:57:42.769443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625729a7-0185-4d3e-85c9-575460ecb493 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:57:42.769737 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625729a7-0185-4d3e-85c9-575460ecb493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:57:42.771581 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-625729a7-0185-4d3e-85c9-575460ecb493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:57:42.811989 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:42.836816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625729a7-0185-4d3e-85c9-575460ecb493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:57:42.838259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625729a7-0185-4d3e-85c9-575460ecb493 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:57:42.847637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1402/2733] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:57:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:57:50.992045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:57:52.843442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=12 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:22.204887 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:22.266289 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53ed96-4d39-4221-a0d6-84015190cd6f service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:22.270744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:22.271647 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:22.271939 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:22.272219 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] PATH_INFO: `/v3/users/5ab3217ba84a45d0ba14039112ba9967` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:22.273386 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab3217ba84a45d0ba14039112ba9967)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:22.275326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:22.320312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab3217ba84a45d0ba14039112ba9967'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.326991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab3217ba84a45d0ba14039112ba9967'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.334636 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab3217ba84a45d0ba14039112ba9967'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.335261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab3217ba84a45d0ba14039112ba9967'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.335883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab3217ba84a45d0ba14039112ba9967'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.353442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1332/2734] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:22 2022] DELETE /identity/v3/users/5ab3217ba84a45d0ba14039112ba9967 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:22.357984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:22.358475 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:22.358588 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:22.375277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:22.376625 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:22.435896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1403/2735] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:22.445414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:22.446882 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:22.504011 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412475b7-9162-4e12-915e-5136beb85cc9 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:22.507643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512744c1-e617-4c25-afff-b704f15c910d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:22.508291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512744c1-e617-4c25-afff-b704f15c910d service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:22.508578 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512744c1-e617-4c25-afff-b704f15c910d service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:22.508859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512744c1-e617-4c25-afff-b704f15c910d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:22.518134 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512744c1-e617-4c25-afff-b704f15c910d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:22.519592 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512744c1-e617-4c25-afff-b704f15c910d service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:22.528985 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1333/2736] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:22.798668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:22.800140 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:22.813816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bef38b-28b6-4e67-939b-a124e7771ff8 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:22.818988 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:22.820017 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:22.820447 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:22.820857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] PATH_INFO: `/v3/projects/ffa4759b05a1433a83a639b44935cea8` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:22.822123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa4759b05a1433a83a639b44935cea8)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:22.824144 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:22.871795 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa4759b05a1433a83a639b44935cea8', 'request_id': 'req-f8a78c04-66a5-4b8e-8abd-802237c3a603'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.879417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa4759b05a1433a83a639b44935cea8', 'request_id': 'req-f8a78c04-66a5-4b8e-8abd-802237c3a603'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.884958 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa4759b05a1433a83a639b44935cea8', 'request_id': 'req-f8a78c04-66a5-4b8e-8abd-802237c3a603'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.896442 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] The token cache is being invalidate because project ffa4759b05a1433a83a639b44935cea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:22.896733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.897364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:22.898905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1404/2737] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:22 2022] DELETE /identity/v3/projects/ffa4759b05a1433a83a639b44935cea8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:22.903827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d758-a6ad-4543-a87a-874b2248de38 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:22.904127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d758-a6ad-4543-a87a-874b2248de38 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:22.904414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924d758-a6ad-4543-a87a-874b2248de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:22.922442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-8924d758-a6ad-4543-a87a-874b2248de38 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:22.923686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8924d758-a6ad-4543-a87a-874b2248de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:22.940970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:22.947943 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:22.949530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:22.990670 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1334/2738] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:22.998323 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05befa8-2ad2-4f5e-aa37-cba5c4045b4d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:22.998623 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05befa8-2ad2-4f5e-aa37-cba5c4045b4d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:22.998909 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05befa8-2ad2-4f5e-aa37-cba5c4045b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.016687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a78c04-66a5-4b8e-8abd-802237c3a603 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.019096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e05befa8-2ad2-4f5e-aa37-cba5c4045b4d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:23.020428 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e05befa8-2ad2-4f5e-aa37-cba5c4045b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.021777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.022756 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.023084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.023373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] PATH_INFO: `/v3/users/b2160f03bec742e1b5ed020e92a1e6e8` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.024721 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2160f03bec742e1b5ed020e92a1e6e8)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.026674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.030116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1335/2739] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:58:23.034317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05befa8-2ad2-4f5e-aa37-cba5c4045b4d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.043957 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05befa8-2ad2-4f5e-aa37-cba5c4045b4d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.050484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.051203 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.051496 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.051782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.052521 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:58:23.052832 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.054445 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.060269 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:23.077956 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1336/2740] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:58:23.078815 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.090067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2160f03bec742e1b5ed020e92a1e6e8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.091182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7fa42-074c-44d8-8227-e5aa1578c857 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.096094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.096950 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.097248 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.097531 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.098295 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.098749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2160f03bec742e1b5ed020e92a1e6e8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.100016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2160f03bec742e1b5ed020e92a1e6e8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.100317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.107670 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2160f03bec742e1b5ed020e92a1e6e8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.122261 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2ef48d39-c05a-4d81-b229-05a2b55c09aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2160f03bec742e1b5ed020e92a1e6e8'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.127258 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1337/2741] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:23 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:58:23.128933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1405/2742] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:22 2022] DELETE /identity/v3/users/b2160f03bec742e1b5ed020e92a1e6e8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:58:23.131400 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.133059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.133201 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.133476 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.133771 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.151050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:23.152242 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.195915 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225caa-7453-440b-962f-50b222b86dd4 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.216048 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1406/2743] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:58:23.225585 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.227151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.253934 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.254633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.254936 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.255240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.255948 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.257868 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.283065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1338/2744] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:23 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:23.283065 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.288663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f384a-fbce-4848-9166-b1cdcb2f0944 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.292273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff810c-0d54-419a-9227-0cb42393f2b3 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.292400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.293028 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.293573 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.293853 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.297805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.298450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.298791 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.299207 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.299930 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.302346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.303640 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.305081 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.316809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1339/2745] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:58:23.317000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1407/2746] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:58:23.318130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.328115 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd365d8-0222-4dea-84da-0c067f91c542 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.332705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf9d17-9109-4679-9a2f-bcfcbed23272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.333435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9d17-9109-4679-9a2f-bcfcbed23272 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.333729 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9d17-9109-4679-9a2f-bcfcbed23272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.334012 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9d17-9109-4679-9a2f-bcfcbed23272 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.334754 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf9d17-9109-4679-9a2f-bcfcbed23272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.336377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf9d17-9109-4679-9a2f-bcfcbed23272 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.337658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:23.349429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1340/2747] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:23.353443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.363466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88992513-594d-4225-aedf-7d2e5e126f2c service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.368335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.369302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.369589 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.369868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] PATH_INFO: `/v3/projects/3a250f27534a4f71a7ad112ab99cfaff/users/a1be4997aec142959b6c3a84aa030ab1/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.386654 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a250f27534a4f71a7ad112ab99cfaff, user_id=a1be4997aec142959b6c3a84aa030ab1, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.389383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.402668 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1408/2748] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:23 2022] PUT /identity/v3/projects/3a250f27534a4f71a7ad112ab99cfaff/users/a1be4997aec142959b6c3a84aa030ab1/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:23.412968 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.413462 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.413827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.441922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] MFA Rules not processed for user `a1be4997aec142959b6c3a84aa030ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:23.443250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.512672 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1341/2749] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:23.517426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.541920 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:23.581215 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415d68-74dc-4cc1-a047-3758122c7edb admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.586543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.587308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.587594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.587873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.588565 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.590448 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.592534 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.595374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.615128 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbebfe5-09a3-4d5f-bc9d-bc6a3ac45eff None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.621249 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.622140 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.622426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.622885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] PATH_INFO: `/v3/projects/d3eabc83dbb94ba685b857d803872247` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.623952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1409/2750] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:23 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:23.624692 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3eabc83dbb94ba685b857d803872247)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.625479 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.626605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.676505 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3eabc83dbb94ba685b857d803872247', 'request_id': 'req-02a1c8ee-459a-4796-bd25-db069bc4fdba'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.684331 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3eabc83dbb94ba685b857d803872247', 'request_id': 'req-02a1c8ee-459a-4796-bd25-db069bc4fdba'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.691106 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3eabc83dbb94ba685b857d803872247', 'request_id': 'req-02a1c8ee-459a-4796-bd25-db069bc4fdba'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.692031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e51474-3214-444a-a66d-abf0d137393a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.702658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] The token cache is being invalidate because project d3eabc83dbb94ba685b857d803872247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:23.702969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.703652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.705280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1342/2751] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:23 2022] DELETE /identity/v3/projects/d3eabc83dbb94ba685b857d803872247 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:58:23.709149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.710646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.753979 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.754674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.754995 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.755283 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.755983 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.757905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.780658 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1410/2752] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:23 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:23.781952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.783572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:23.785346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c8ee-459a-4796-bd25-db069bc4fdba admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.789989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.790880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.791197 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.791478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] PATH_INFO: `/v3/users/4ca2ccbed9ad4600b028b844c00bffd7` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.792676 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca2ccbed9ad4600b028b844c00bffd7)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.794839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.795365 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709cf1b-4d99-48e2-a103-35776389c0c8 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.800739 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.801393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.801690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.801976 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.802707 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.804327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.805880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:23.815725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1411/2753] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:58:23.820605 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.831636 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89c97c-f503-45a8-bc1d-6e7184bb6fe0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.836278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.836937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.837230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.837517 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.838273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.840158 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.841485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca2ccbed9ad4600b028b844c00bffd7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.848805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca2ccbed9ad4600b028b844c00bffd7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.850873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1412/2754] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:23.854857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:23.860158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca2ccbed9ad4600b028b844c00bffd7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.860878 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca2ccbed9ad4600b028b844c00bffd7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.861501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-ff3f18c4-5bde-43b5-a297-d1ec05d04b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca2ccbed9ad4600b028b844c00bffd7'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:23.865466 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a36b28-95fd-4b57-9688-bb38cf56491a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:23.870092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:23.870969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.871258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.871535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] PATH_INFO: `/v3/projects/b2980065ae9242e09a23710b317a5ad4/users/1b9d2d3cb91e49dd95002cc3d0714151/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.880520 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1343/2755] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:23 2022] DELETE /identity/v3/users/4ca2ccbed9ad4600b028b844c00bffd7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:58:23.886614 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2980065ae9242e09a23710b317a5ad4, user_id=1b9d2d3cb91e49dd95002cc3d0714151, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:23.889516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:23.898303 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:23.904558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1413/2756] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:23 2022] PUT /identity/v3/projects/b2980065ae9242e09a23710b317a5ad4/users/1b9d2d3cb91e49dd95002cc3d0714151/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:58:23.914686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97019e-4235-483e-bdb6-6c52401e35c6 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:23.915132 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97019e-4235-483e-bdb6-6c52401e35c6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:23.915502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97019e-4235-483e-bdb6-6c52401e35c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:23.945976 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3f97019e-4235-483e-bdb6-6c52401e35c6 None None] MFA Rules not processed for user `1b9d2d3cb91e49dd95002cc3d0714151`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:23.947426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3f97019e-4235-483e-bdb6-6c52401e35c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.018303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1344/2757] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:24.022726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.024663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.092764 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73c32a-c26a-40fe-936c-b85beac5d6f0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.097871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.098544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.098809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.099121 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.099825 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.101722 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.127861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1414/2758] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:24.132273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97019e-4235-483e-bdb6-6c52401e35c6 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.144753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97019e-4235-483e-bdb6-6c52401e35c6 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.154672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.156936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.208732 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.209340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.209632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.209917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.210666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.212613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.227848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5acd0-7465-4918-92aa-aa68eb6841cc admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.232915 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.233896 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.234193 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.234488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] PATH_INFO: `/v3/projects/995dc32ba1114cb6b7c97f23d13bc940` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.235253 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1345/2759] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:24.235808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995dc32ba1114cb6b7c97f23d13bc940)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.237509 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.237729 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.248032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4fc6-c8fd-4d8c-b132-5ce5b35d9568 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.253263 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.253974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.254537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.254656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.255430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.257008 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.258282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:24.272378 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1346/2760] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:58:24.273398 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.283591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4fc76-a387-4b07-898a-e231a5444eb6 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.289937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995dc32ba1114cb6b7c97f23d13bc940', 'request_id': 'req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:24.300629 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995dc32ba1114cb6b7c97f23d13bc940', 'request_id': 'req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:24.306594 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995dc32ba1114cb6b7c97f23d13bc940', 'request_id': 'req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:24.318173 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] The token cache is being invalidate because project 995dc32ba1114cb6b7c97f23d13bc940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:24.318469 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:24.319172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-2e3d77bb-519b-4e66-818b-d18d9e34a0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:24.320826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1415/2761] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:24 2022] DELETE /identity/v3/projects/995dc32ba1114cb6b7c97f23d13bc940 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:58:24.326219 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca33ee-dc02-4815-8850-b8666f34a14a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.326666 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca33ee-dc02-4815-8850-b8666f34a14a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.326996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca33ee-dc02-4815-8850-b8666f34a14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.343850 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.345028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.345314 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.345593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] PATH_INFO: `/v3/projects/d651755f932b4685a6c6e87d7a6b46f8/users/83766d69474c4aa0867178273f8e61ad/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.346837 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-89ca33ee-dc02-4815-8850-b8666f34a14a None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:24.348098 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-89ca33ee-dc02-4815-8850-b8666f34a14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.356188 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1416/2762] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:58:24.364228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badd29-2f10-491c-b422-8a57a4a08c1c None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.364782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badd29-2f10-491c-b422-8a57a4a08c1c None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.364782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33badd29-2f10-491c-b422-8a57a4a08c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.367799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d651755f932b4685a6c6e87d7a6b46f8, user_id=83766d69474c4aa0867178273f8e61ad, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.370447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.377155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:24.383426 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-33badd29-2f10-491c-b422-8a57a4a08c1c None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:24.383594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1347/2763] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:24 2022] PUT /identity/v3/projects/d651755f932b4685a6c6e87d7a6b46f8/users/83766d69474c4aa0867178273f8e61ad/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:58:24.385584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-33badd29-2f10-491c-b422-8a57a4a08c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.387533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.389096 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.450039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1417/2764] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:58:24.451137 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badd29-2f10-491c-b422-8a57a4a08c1c None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.455789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6111ca-c20e-4a5c-841c-5bc255b27d3d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.460423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33badd29-2f10-491c-b422-8a57a4a08c1c None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.460627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.461303 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.461595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.461880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.462619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.464299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.465187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.465889 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.466446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.466446 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.467381 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:58:24.467698 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.470059 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.474759 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1348/2765] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:24.478776 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.485104 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1418/2766] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:58:24.486112 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.488304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7202f-b295-445e-a93d-fac8c3b72fe4 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.492881 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c385a2-2fef-44f0-a782-0aa86e93888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.493764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c385a2-2fef-44f0-a782-0aa86e93888c admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.494055 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c385a2-2fef-44f0-a782-0aa86e93888c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.494337 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c385a2-2fef-44f0-a782-0aa86e93888c admin admin] PATH_INFO: `/v3/projects/d651755f932b4685a6c6e87d7a6b46f8/users/83766d69474c4aa0867178273f8e61ad/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.495969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1b403-2b7e-4666-9199-9fc5a221e8a2 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.496342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c385a2-2fef-44f0-a782-0aa86e93888c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d651755f932b4685a6c6e87d7a6b46f8, user_id=83766d69474c4aa0867178273f8e61ad, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.498955 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c385a2-2fef-44f0-a782-0aa86e93888c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.500661 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.501888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.502186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.502490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.503203 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.505091 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.509535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1349/2767] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:24 2022] PUT /identity/v3/projects/d651755f932b4685a6c6e87d7a6b46f8/users/83766d69474c4aa0867178273f8e61ad/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:24.520478 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.520782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.521067 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.536529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1419/2768] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:58:24.537470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.549610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] MFA Rules not processed for user `83766d69474c4aa0867178273f8e61ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:24.550827 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.598512 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708c94-f536-445e-8f22-f2b1334a6dfb admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.598949 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:24.605000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.605686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.605969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.606253 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.606969 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.608951 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.621914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1350/2769] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:58:24.630991 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1420/2770] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:58:24.633212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.633356 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.634661 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.643766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a06c3d-1ef4-4359-811b-dd1a52faec21 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.648380 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.649032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.649316 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.649627 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.650357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.652093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.664964 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1421/2771] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:58:24.666257 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.676033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9a8d-0971-4dcc-bc32-29311546c94a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.681421 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.682070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.682359 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.682643 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.683403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.684980 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.692083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b8e4b-6fa4-425c-bcb2-575ea37d9274 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.695541 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1422/2772] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:58:24.698736 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.699458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.699755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.700043 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.702035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.702177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.712714 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa31bb-d7b5-47ad-b747-655730de0e7c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.719855 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24bc65-9822-4cf4-8fce-9cfb3c342f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.720934 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24bc65-9822-4cf4-8fce-9cfb3c342f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.721228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24bc65-9822-4cf4-8fce-9cfb3c342f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.721645 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24bc65-9822-4cf4-8fce-9cfb3c342f5c admin admin] PATH_INFO: `/v3/projects/2dcc0ac76dd344c5a9dc0a65a83e9af3/users/bfee80c923b949f0a6b4adebf0634757/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.736699 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24bc65-9822-4cf4-8fce-9cfb3c342f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcc0ac76dd344c5a9dc0a65a83e9af3, user_id=bfee80c923b949f0a6b4adebf0634757, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.739393 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24bc65-9822-4cf4-8fce-9cfb3c342f5c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.753768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1423/2773] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:24 2022] PUT /identity/v3/projects/2dcc0ac76dd344c5a9dc0a65a83e9af3/users/bfee80c923b949f0a6b4adebf0634757/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:24.763637 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7152d-809c-4fc0-9fe8-6f5af1992364 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.763937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7152d-809c-4fc0-9fe8-6f5af1992364 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.764218 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7152d-809c-4fc0-9fe8-6f5af1992364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.768084 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.769524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.778349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1351/2774] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:58:24.789891 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-a0c7152d-809c-4fc0-9fe8-6f5af1992364 None None] MFA Rules not processed for user `bfee80c923b949f0a6b4adebf0634757`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:24.791127 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a0c7152d-809c-4fc0-9fe8-6f5af1992364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:24.795349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:24.864029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1424/2775] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:58:24.868656 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.879502 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6c99-92ad-4907-b283-d21e66daa239 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:24.940843 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:24.941550 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:24.941841 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:24.942127 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:24.942823 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:24.944774 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:24.975958 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1352/2776] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:24.977922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7152d-809c-4fc0-9fe8-6f5af1992364 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:24.992072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7152d-809c-4fc0-9fe8-6f5af1992364 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.060050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.060738 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.061026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.061306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.062282 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.064195 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.087873 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1425/2777] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:24 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:25.088709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:25.099486 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eacb3-4e80-4218-929e-a99cc046f578 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.104591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.105298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.105618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.105873 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.106612 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.110029 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.120961 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1353/2778] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:58:25.125196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:25.136428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fdb3c-ca81-4d36-b424-2b4aec0798c0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.141518 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.142409 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.142704 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.143045 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] PATH_INFO: `/v3/projects/ad2c64f47f074e3bbed29873f040fe23/users/daf5da44028c4b7084851ff569843bd2/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.158298 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2c64f47f074e3bbed29873f040fe23, user_id=daf5da44028c4b7084851ff569843bd2, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.160977 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.175062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1426/2779] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:25 2022] PUT /identity/v3/projects/ad2c64f47f074e3bbed29873f040fe23/users/daf5da44028c4b7084851ff569843bd2/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:25.178693 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:25.188566 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe73957-367e-4a91-b7b7-002163ab5a88 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.199720 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:25.245666 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d06648-e1e9-4217-9c8b-c3fd3cd26d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.246340 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06648-e1e9-4217-9c8b-c3fd3cd26d20 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.246632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06648-e1e9-4217-9c8b-c3fd3cd26d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.246944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06648-e1e9-4217-9c8b-c3fd3cd26d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.247663 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d06648-e1e9-4217-9c8b-c3fd3cd26d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.249274 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d06648-e1e9-4217-9c8b-c3fd3cd26d20 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.258700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1354/2780] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:25.262752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:25.273584 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda483cc-b351-4bad-a4d1-c2024f43dd48 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.278152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.279085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.279382 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.279669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] PATH_INFO: `/v3/projects/ad2c64f47f074e3bbed29873f040fe23/users/daf5da44028c4b7084851ff569843bd2/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.282204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2c64f47f074e3bbed29873f040fe23, user_id=daf5da44028c4b7084851ff569843bd2, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.284888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.295240 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1427/2781] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:25 2022] PUT /identity/v3/projects/ad2c64f47f074e3bbed29873f040fe23/users/daf5da44028c4b7084851ff569843bd2/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:25.305245 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47df8-ee7a-4301-9480-aff00282e232 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.305545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47df8-ee7a-4301-9480-aff00282e232 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.305835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47df8-ee7a-4301-9480-aff00282e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.333317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-88e47df8-ee7a-4301-9480-aff00282e232 None None] MFA Rules not processed for user `daf5da44028c4b7084851ff569843bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:25.334547 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-88e47df8-ee7a-4301-9480-aff00282e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:25.402167 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1355/2782] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:25.414035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:25.467084 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcab0d-b8e7-4312-8a9d-fe1982d90ce5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.471366 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74051b0-ef5d-4220-b204-e81e251a1f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.472008 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74051b0-ef5d-4220-b204-e81e251a1f2b service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.472297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74051b0-ef5d-4220-b204-e81e251a1f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.472580 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74051b0-ef5d-4220-b204-e81e251a1f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.481401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74051b0-ef5d-4220-b204-e81e251a1f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.482834 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74051b0-ef5d-4220-b204-e81e251a1f2b service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.487777 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:25.492916 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1428/2783] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:25.519686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47df8-ee7a-4301-9480-aff00282e232 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:25.580835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47df8-ee7a-4301-9480-aff00282e232 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.585574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.586458 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.586744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.587045 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] PATH_INFO: `/v3/users/bfee80c923b949f0a6b4adebf0634757` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.588225 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfee80c923b949f0a6b4adebf0634757)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.590174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.629109 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:25.636024 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfee80c923b949f0a6b4adebf0634757'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:25.643565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfee80c923b949f0a6b4adebf0634757'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:25.651176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfee80c923b949f0a6b4adebf0634757'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:25.651884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfee80c923b949f0a6b4adebf0634757'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:25.652580 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfee80c923b949f0a6b4adebf0634757'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:25.670444 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1356/2784] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:25 2022] DELETE /identity/v3/users/bfee80c923b949f0a6b4adebf0634757 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:25.674963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.675271 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.675563 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.695313 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:25.696539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:25.755960 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1429/2785] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 18:58:25.766149 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:25.767669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:25.822970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505a24-1988-4305-b4aa-d31c5a3e915d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:25.826615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:25.827309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:25.828125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:25.828408 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:25.837281 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:25.838702 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:25.848125 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1357/2786] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:26.106181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:26.107809 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:26.122551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd1f1b-3ea0-4e08-8259-3b84914e2aa5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:26.128423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:26.129551 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:26.129828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:26.130228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] PATH_INFO: `/v3/projects/2dcc0ac76dd344c5a9dc0a65a83e9af3` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:26.131552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcc0ac76dd344c5a9dc0a65a83e9af3)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:26.133996 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:26.182102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcc0ac76dd344c5a9dc0a65a83e9af3', 'request_id': 'req-a3bd9327-6500-470d-9087-5e7a4d445e7a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.190455 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcc0ac76dd344c5a9dc0a65a83e9af3', 'request_id': 'req-a3bd9327-6500-470d-9087-5e7a4d445e7a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.196412 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcc0ac76dd344c5a9dc0a65a83e9af3', 'request_id': 'req-a3bd9327-6500-470d-9087-5e7a4d445e7a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.208513 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] The token cache is being invalidate because project 2dcc0ac76dd344c5a9dc0a65a83e9af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:26.208805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.209483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.211164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1430/2787] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:26 2022] DELETE /identity/v3/projects/2dcc0ac76dd344c5a9dc0a65a83e9af3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:26.215014 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:26.224696 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dbdef-c090-4e65-9522-7169e0cff7d6 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:26.262660 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:26.264066 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:26.283913 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:26.284734 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:26.285020 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:26.285301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] PATH_INFO: `/v3/users/daf5da44028c4b7084851ff569843bd2` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:26.286606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf5da44028c4b7084851ff569843bd2)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:26.288663 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:26.326632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd9327-6500-470d-9087-5e7a4d445e7a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:26.331052 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb605b-7f1b-474e-9cfe-ec1ea229414d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:26.331715 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb605b-7f1b-474e-9cfe-ec1ea229414d service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:26.332004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb605b-7f1b-474e-9cfe-ec1ea229414d service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:26.332284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb605b-7f1b-474e-9cfe-ec1ea229414d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:26.334159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-0dcb605b-7f1b-474e-9cfe-ec1ea229414d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:26.338777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf5da44028c4b7084851ff569843bd2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.345726 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf5da44028c4b7084851ff569843bd2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.349680 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:26.354172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf5da44028c4b7084851ff569843bd2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.355526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf5da44028c4b7084851ff569843bd2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.356278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf5da44028c4b7084851ff569843bd2'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.375705 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1358/2788] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:26 2022] DELETE /identity/v3/users/daf5da44028c4b7084851ff569843bd2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:26.377020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:26.398691 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb605b-7f1b-474e-9cfe-ec1ea229414d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:26.400230 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb605b-7f1b-474e-9cfe-ec1ea229414d service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:26.409829 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1431/2789] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:26.663789 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:26.665585 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:26.743837 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03e58-b788-4739-bdc3-d665a198f8ed admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:26.748755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:26.749683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:26.749970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:26.750251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] PATH_INFO: `/v3/projects/ad2c64f47f074e3bbed29873f040fe23` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:26.751485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2c64f47f074e3bbed29873f040fe23)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:26.753403 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:26.801353 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2c64f47f074e3bbed29873f040fe23', 'request_id': 'req-25d78ace-8199-4545-adb6-af14990ff46f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.808804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2c64f47f074e3bbed29873f040fe23', 'request_id': 'req-25d78ace-8199-4545-adb6-af14990ff46f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.814891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2c64f47f074e3bbed29873f040fe23', 'request_id': 'req-25d78ace-8199-4545-adb6-af14990ff46f'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.826286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] The token cache is being invalidate because project ad2c64f47f074e3bbed29873f040fe23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:26.826645 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.827952 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-25d78ace-8199-4545-adb6-af14990ff46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:26.829689 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1359/2790] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:26 2022] DELETE /identity/v3/projects/ad2c64f47f074e3bbed29873f040fe23 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:26.834452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:26.834944 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:26.835211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:26.854632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:26.855931 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:26.917443 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1432/2791] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:26.930120 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1750b-6396-41c5-a696-1af30865d8a4 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:26.930448 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1750b-6396-41c5-a696-1af30865d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:26.930695 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1750b-6396-41c5-a696-1af30865d8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:26.952969 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3da1750b-6396-41c5-a696-1af30865d8a4 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:26.954465 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3da1750b-6396-41c5-a696-1af30865d8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:26.954582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:26.955856 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:26.966677 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1360/2792] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:26.971460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1750b-6396-41c5-a696-1af30865d8a4 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:26.980537 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1750b-6396-41c5-a696-1af30865d8a4 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:26.985229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:26.985874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:26.986161 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:26.986443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:26.987202 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:58:26.987513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:26.989179 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.000767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1361/2793] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:58:27.004812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.014374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06568-ea51-42db-aec2-19b19d012b20 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.016252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a821-7fef-4d23-b353-74f6b8f8aa00 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.019538 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.019904 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.020176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.020463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.020567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.020746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.020861 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.021107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.021420 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.023000 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:27.023377 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.050821 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1362/2794] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:27 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:58:27.054900 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.084842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:27.089798 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.091385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.102011 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1433/2795] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:27.121409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e2fef-325f-4428-b491-1880ca3f8b51 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.127208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.127885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.128174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.128454 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.129158 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.131086 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.154584 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1363/2796] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:27 2022] POST /identity/v3/users => generated 304 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:58:27.156633 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.167521 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab47bb-9c77-4e7b-903c-837ac0a619c1 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.173153 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.173868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.174114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.174391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.175150 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.176752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.188679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1434/2797] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:27.192678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.206614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11839cde-c9cb-4c55-ae6f-87519c188320 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.208131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c65de-101a-4ef0-8f23-bbab7e5a7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.208804 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c65de-101a-4ef0-8f23-bbab7e5a7ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.209098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c65de-101a-4ef0-8f23-bbab7e5a7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.209385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c65de-101a-4ef0-8f23-bbab7e5a7ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.210122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c65de-101a-4ef0-8f23-bbab7e5a7ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.211744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c65de-101a-4ef0-8f23-bbab7e5a7ec9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.221865 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1364/2798] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:27.226103 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.236113 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f51c4-4c38-438f-8f0b-3825d75d6b23 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.240742 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.241632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.241924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.242211 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] PATH_INFO: `/v3/projects/fe6df44a58b44ce38828167d6ced3eac/users/7bf633ed2de14c0c895a6edc5a865c36/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.257254 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6df44a58b44ce38828167d6ced3eac, user_id=7bf633ed2de14c0c895a6edc5a865c36, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.259952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.262126 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=100 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:27.274116 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1435/2799] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:27 2022] PUT /identity/v3/projects/fe6df44a58b44ce38828167d6ced3eac/users/7bf633ed2de14c0c895a6edc5a865c36/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:27.284903 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4224-8ec5-476d-8bb2-dd8f9876bfce None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.285419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4224-8ec5-476d-8bb2-dd8f9876bfce None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.285574 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4224-8ec5-476d-8bb2-dd8f9876bfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.315139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-bc2d4224-8ec5-476d-8bb2-dd8f9876bfce None None] MFA Rules not processed for user `7bf633ed2de14c0c895a6edc5a865c36`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:27.316382 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bc2d4224-8ec5-476d-8bb2-dd8f9876bfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:27.382595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1365/2800] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:27.387021 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.450167 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9432-6097-428f-b361-b60340af4389 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.455043 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.455740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.456033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.456319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.457029 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.458956 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.483004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1436/2801] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:27 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:27.487490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4224-8ec5-476d-8bb2-dd8f9876bfce None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.497916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4224-8ec5-476d-8bb2-dd8f9876bfce None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.552669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.553343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.553633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.553917 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.554613 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.556565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.576009 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1366/2802] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:27 2022] POST /identity/v3/users => generated 311 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:27.579919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.590152 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc4ae-5fe6-497c-92d0-a78e620f674b admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.595207 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.595881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.596170 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.596452 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.597189 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.598791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.609961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1437/2803] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:27.614083 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.625116 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0b22-7dea-431c-8b70-8e7aa8ade440 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.629874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.630770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.631094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.631379 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] PATH_INFO: `/v3/projects/723ff0ee1f5742c5bcbac20f51117b98/users/c9a2429366be40f8a986a9b919238d1b/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.645701 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] RBAC: Authorizing `identity:create_grant(project_id=723ff0ee1f5742c5bcbac20f51117b98, user_id=c9a2429366be40f8a986a9b919238d1b, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.648355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.657047 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:27.662450 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1367/2804] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:27 2022] PUT /identity/v3/projects/723ff0ee1f5742c5bcbac20f51117b98/users/c9a2429366be40f8a986a9b919238d1b/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:27.666491 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.677252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e2838-a57b-4dd7-8d31-070d62023cea admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.734073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184444a0-190f-4fd9-a938-d1fd2aa218c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.734754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184444a0-190f-4fd9-a938-d1fd2aa218c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.735072 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184444a0-190f-4fd9-a938-d1fd2aa218c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.735358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184444a0-190f-4fd9-a938-d1fd2aa218c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.736085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184444a0-190f-4fd9-a938-d1fd2aa218c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.737678 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184444a0-190f-4fd9-a938-d1fd2aa218c4 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.747300 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1438/2805] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:27.752044 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.762175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524629-43cc-404a-abcc-ec02e9f0765d admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.766784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.767703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.767989 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.768269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] PATH_INFO: `/v3/projects/723ff0ee1f5742c5bcbac20f51117b98/users/c9a2429366be40f8a986a9b919238d1b/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.770250 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=723ff0ee1f5742c5bcbac20f51117b98, user_id=c9a2429366be40f8a986a9b919238d1b, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.772891 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.782766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1368/2806] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:27 2022] PUT /identity/v3/projects/723ff0ee1f5742c5bcbac20f51117b98/users/c9a2429366be40f8a986a9b919238d1b/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:27.792832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f28f6-9caf-4fa9-8654-1d274492b5a6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.793133 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f28f6-9caf-4fa9-8654-1d274492b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.793672 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f28f6-9caf-4fa9-8654-1d274492b5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.820445 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-641f28f6-9caf-4fa9-8654-1d274492b5a6 None None] MFA Rules not processed for user `c9a2429366be40f8a986a9b919238d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:27.821683 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-641f28f6-9caf-4fa9-8654-1d274492b5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:27.871212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:27.890608 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1439/2807] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:27.901260 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:27.956182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbefee-9d69-474d-bd1b-4e7a4263b02b admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:27.959830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:27.960472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:27.960761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:27.961042 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:27.970429 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:27.971877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:27.981231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1369/2808] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:28.127477 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f28f6-9caf-4fa9-8654-1d274492b5a6 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:28.136936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f28f6-9caf-4fa9-8654-1d274492b5a6 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:28.140432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c8601-533a-4135-a50b-48fbc418ff9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:28.141065 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8601-533a-4135-a50b-48fbc418ff9c service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:28.141352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8601-533a-4135-a50b-48fbc418ff9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:28.141632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8601-533a-4135-a50b-48fbc418ff9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:28.196961 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c8601-533a-4135-a50b-48fbc418ff9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:28.198390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c8601-533a-4135-a50b-48fbc418ff9c service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:28.207595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1440/2809] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:28 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:58:30.946605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:30.948160 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:31.012150 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68f540-6ea2-43b6-bfab-550ad5211d78 service cinder] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:31.016586 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:31.017461 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:31.017744 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:31.018022 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] PATH_INFO: `/v3/users/a1be4997aec142959b6c3a84aa030ab1` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:31.019231 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1be4997aec142959b6c3a84aa030ab1)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:31.021122 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:31.067199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1be4997aec142959b6c3a84aa030ab1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.074099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1be4997aec142959b6c3a84aa030ab1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.081808 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1be4997aec142959b6c3a84aa030ab1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.082442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1be4997aec142959b6c3a84aa030ab1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.083095 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1be4997aec142959b6c3a84aa030ab1'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.100739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1370/2810] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:30 2022] DELETE /identity/v3/users/a1be4997aec142959b6c3a84aa030ab1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:31.105385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:31.105854 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:31.105952 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:31.126036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:31.127266 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:31.184379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1441/2811] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:31.193831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:31.195298 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:31.206562 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:31.253114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd683-1ae1-4a24-b348-8bcad2a0fd63 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:31.256784 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:31.257427 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:31.257719 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:31.258001 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:31.267498 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:31.268927 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:31.278169 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1371/2812] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:31.546357 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:31.547874 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:31.559597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01300-d8bd-421b-9653-e5d40f8c5db5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:31.564650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:31.565519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:31.565805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:31.566082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] PATH_INFO: `/v3/projects/3a250f27534a4f71a7ad112ab99cfaff` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:31.567288 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a250f27534a4f71a7ad112ab99cfaff)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:31.569176 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:31.615327 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a250f27534a4f71a7ad112ab99cfaff', 'request_id': 'req-3ed00561-4ca1-480f-986c-28dc9eab4d8a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.623488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a250f27534a4f71a7ad112ab99cfaff', 'request_id': 'req-3ed00561-4ca1-480f-986c-28dc9eab4d8a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.629492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a250f27534a4f71a7ad112ab99cfaff', 'request_id': 'req-3ed00561-4ca1-480f-986c-28dc9eab4d8a'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.640319 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] The token cache is being invalidate because project 3a250f27534a4f71a7ad112ab99cfaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:31.641181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.641812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.643372 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1442/2813] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:31 2022] DELETE /identity/v3/projects/3a250f27534a4f71a7ad112ab99cfaff => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:31.647301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:31.656867 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29111-f832-4216-97f2-6ea0d4565691 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:31.712071 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:31.712897 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:31.713185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:31.713467 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] PATH_INFO: `/v3/users/1b9d2d3cb91e49dd95002cc3d0714151` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:31.714658 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9d2d3cb91e49dd95002cc3d0714151)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:31.717243 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:31.761894 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9d2d3cb91e49dd95002cc3d0714151'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.768812 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9d2d3cb91e49dd95002cc3d0714151'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.775364 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9d2d3cb91e49dd95002cc3d0714151'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.776003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9d2d3cb91e49dd95002cc3d0714151'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.776633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9d2d3cb91e49dd95002cc3d0714151'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:31.795003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1372/2814] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:31 2022] DELETE /identity/v3/users/1b9d2d3cb91e49dd95002cc3d0714151 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:32.056289 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:32.057890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:32.076495 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed00561-4ca1-480f-986c-28dc9eab4d8a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:32.086603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:32.136733 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:32.137597 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:32.137881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:32.138157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] PATH_INFO: `/v3/projects/b2980065ae9242e09a23710b317a5ad4` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:32.139360 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2980065ae9242e09a23710b317a5ad4)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:32.141309 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:32.185172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2980065ae9242e09a23710b317a5ad4', 'request_id': 'req-60fa9596-3609-45ff-b4a3-e0c9baff324c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.193015 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2980065ae9242e09a23710b317a5ad4', 'request_id': 'req-60fa9596-3609-45ff-b4a3-e0c9baff324c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.198693 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2980065ae9242e09a23710b317a5ad4', 'request_id': 'req-60fa9596-3609-45ff-b4a3-e0c9baff324c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.209632 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] The token cache is being invalidate because project b2980065ae9242e09a23710b317a5ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:32.209924 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.210556 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.212114 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1443/2815] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:32 2022] DELETE /identity/v3/projects/b2980065ae9242e09a23710b317a5ad4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:32.216013 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:32.217406 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:32.230333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dc4ad-73af-4a89-bf4a-34be7a8a17f2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:32.259699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:32.288653 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:32.289542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:32.289835 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:32.290124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] PATH_INFO: `/v3/users/83766d69474c4aa0867178273f8e61ad` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:32.291348 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83766d69474c4aa0867178273f8e61ad)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:32.293262 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:32.346626 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83766d69474c4aa0867178273f8e61ad'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.353855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83766d69474c4aa0867178273f8e61ad'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.360983 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83766d69474c4aa0867178273f8e61ad'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.361602 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83766d69474c4aa0867178273f8e61ad'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.362210 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83766d69474c4aa0867178273f8e61ad'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.379649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1373/2816] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:32 2022] DELETE /identity/v3/users/83766d69474c4aa0867178273f8e61ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:32.642641 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:32.644204 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:32.658425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9596-3609-45ff-b4a3-e0c9baff324c admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:32.717064 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:32.717962 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:32.718252 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:32.718558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] PATH_INFO: `/v3/projects/d651755f932b4685a6c6e87d7a6b46f8` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:32.719866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d651755f932b4685a6c6e87d7a6b46f8)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:32.721793 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:32.767730 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:32.772183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd651755f932b4685a6c6e87d7a6b46f8', 'request_id': 'req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.779436 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd651755f932b4685a6c6e87d7a6b46f8', 'request_id': 'req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.785026 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd651755f932b4685a6c6e87d7a6b46f8', 'request_id': 'req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.796177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] The token cache is being invalidate because project d651755f932b4685a6c6e87d7a6b46f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:32.796471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.797649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c89372ae-b1f4-4c8a-997e-b10b86c64f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:32.799248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1444/2817] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:32 2022] DELETE /identity/v3/projects/d651755f932b4685a6c6e87d7a6b46f8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:37.561276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:37.562826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:37.575593 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db82708-e53d-4ce6-8aae-9e5eada4c819 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:37.633183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:37.634059 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:37.634341 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:37.634618 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] PATH_INFO: `/v3/users/7bf633ed2de14c0c895a6edc5a865c36` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:37.635817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf633ed2de14c0c895a6edc5a865c36)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:37.637761 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:37.682747 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf633ed2de14c0c895a6edc5a865c36'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:37.687153 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:37.690276 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf633ed2de14c0c895a6edc5a865c36'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:37.698269 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf633ed2de14c0c895a6edc5a865c36'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:37.699328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf633ed2de14c0c895a6edc5a865c36'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:37.699971 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf633ed2de14c0c895a6edc5a865c36'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:37.717030 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1374/2818] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:37 2022] DELETE /identity/v3/users/7bf633ed2de14c0c895a6edc5a865c36 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:37.721963 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:37.722401 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:37.722529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:37.740329 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:37.741516 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:37.798340 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1445/2819] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:37.808028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:37.809435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:37.864805 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ea695-e521-4c13-b8ba-e2932a1ccee0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:37.868412 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:37.869058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:37.869346 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:37.869629 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:37.878596 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:37.880052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:37.889368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1375/2820] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:38.148062 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:38.149552 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:38.162013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b7ad-3943-4d86-a382-40d13c61708e None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:38.166602 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:38.167526 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:38.167820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:38.168106 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] PATH_INFO: `/v3/projects/fe6df44a58b44ce38828167d6ced3eac` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:38.169560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6df44a58b44ce38828167d6ced3eac)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:38.171510 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:38.217734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6df44a58b44ce38828167d6ced3eac', 'request_id': 'req-9d8e03b3-664c-47d7-9d84-7232aaf67d17'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.225682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6df44a58b44ce38828167d6ced3eac', 'request_id': 'req-9d8e03b3-664c-47d7-9d84-7232aaf67d17'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.231186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6df44a58b44ce38828167d6ced3eac', 'request_id': 'req-9d8e03b3-664c-47d7-9d84-7232aaf67d17'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.242016 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] The token cache is being invalidate because project fe6df44a58b44ce38828167d6ced3eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:38.242302 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.243010 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.244474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1446/2821] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:38 2022] DELETE /identity/v3/projects/fe6df44a58b44ce38828167d6ced3eac => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:38.248388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:38.257753 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e8453-2961-4c47-84c2-1d67c6d77031 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:38.312041 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:38.313446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:38.313728 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:38.314003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] PATH_INFO: `/v3/users/c9a2429366be40f8a986a9b919238d1b` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:38.315199 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a2429366be40f8a986a9b919238d1b)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:38.317094 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:38.361468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a2429366be40f8a986a9b919238d1b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.368914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a2429366be40f8a986a9b919238d1b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.376205 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a2429366be40f8a986a9b919238d1b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.376857 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a2429366be40f8a986a9b919238d1b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.377470 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-f2633e81-e2ef-446a-a08b-f866f1054a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a2429366be40f8a986a9b919238d1b'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.385241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:38.397139 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1376/2822] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:58:38 2022] DELETE /identity/v3/users/c9a2429366be40f8a986a9b919238d1b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:38.662612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:38.664092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:38.678285 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e03b3-664c-47d7-9d84-7232aaf67d17 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:38.728390 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:38.736383 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:38.737558 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:38.738088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:38.738741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] PATH_INFO: `/v3/projects/723ff0ee1f5742c5bcbac20f51117b98` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:38.740260 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] RBAC: Authorizing `identity:delete_project(project_id=723ff0ee1f5742c5bcbac20f51117b98)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:38.742544 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:38.787124 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723ff0ee1f5742c5bcbac20f51117b98', 'request_id': 'req-05a273ae-314c-4d24-96d1-a6b18032079c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.794560 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723ff0ee1f5742c5bcbac20f51117b98', 'request_id': 'req-05a273ae-314c-4d24-96d1-a6b18032079c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.800616 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723ff0ee1f5742c5bcbac20f51117b98', 'request_id': 'req-05a273ae-314c-4d24-96d1-a6b18032079c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.811256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] The token cache is being invalidate because project 723ff0ee1f5742c5bcbac20f51117b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:58:38.811543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.812164 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-05a273ae-314c-4d24-96d1-a6b18032079c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:58:38.814308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1447/2823] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:58:38 2022] DELETE /identity/v3/projects/723ff0ee1f5742c5bcbac20f51117b98 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:58:38.819414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ab90-8708-4f9c-ad79-46340ed7f058 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:38.819895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ab90-8708-4f9c-ad79-46340ed7f058 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:38.820003 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ab90-8708-4f9c-ad79-46340ed7f058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:38.837216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-c037ab90-8708-4f9c-ad79-46340ed7f058 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:38.838401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c037ab90-8708-4f9c-ad79-46340ed7f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:38.895683 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1377/2824] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:38.904465 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8a4b-b97a-420c-a696-4ed186b9f75d None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:38.904763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8a4b-b97a-420c-a696-4ed186b9f75d None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:38.905051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8a4b-b97a-420c-a696-4ed186b9f75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:38.924754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-bbae8a4b-b97a-420c-a696-4ed186b9f75d None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:38.925882 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-bbae8a4b-b97a-420c-a696-4ed186b9f75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:38.933697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1448/2825] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:38.938261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ab90-8708-4f9c-ad79-46340ed7f058 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:38.947842 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ab90-8708-4f9c-ad79-46340ed7f058 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:38.952365 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:38.953058 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:38.953351 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:38.953632 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:38.954358 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:58:38.954669 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:38.956301 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:38.967530 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1378/2826] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 18:58:38.971609 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8a4b-b97a-420c-a696-4ed186b9f75d None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:38.980682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8a4b-b97a-420c-a696-4ed186b9f75d None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:38.985735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:38.986387 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:38.986690 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:38.987125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:38.987883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:38.989760 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:39.014791 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1449/2827] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:58:38 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:58:39.018830 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:39.028970 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484fa02-e463-4625-a14b-41954ee9f9bc admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:39.083581 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:39.084255 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:39.084545 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:39.084831 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:39.085527 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:39.087463 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:39.107023 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1379/2828] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:58:39 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:58:39.111719 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:39.122277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c73f-3202-4b77-8651-d472b791fa09 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:39.126869 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:39.127568 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:39.127862 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:39.128147 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:39.128880 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:39.130778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:39.141194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1450/2829] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:39.144799 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:39.154525 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0010f01-5d8b-4b90-8d4e-e326f277529b admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:39.159667 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cad62-20ec-4de7-ae1c-961e60927922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:39.160319 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cad62-20ec-4de7-ae1c-961e60927922 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:39.160611 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cad62-20ec-4de7-ae1c-961e60927922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:39.160895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cad62-20ec-4de7-ae1c-961e60927922 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:39.161622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cad62-20ec-4de7-ae1c-961e60927922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:39.163232 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cad62-20ec-4de7-ae1c-961e60927922 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:39.174477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1380/2830] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:58:39.178488 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:39.188310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107be1-0af5-46c0-b720-761770348c2e admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:39.192888 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:39.193768 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:39.194060 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:39.194346 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] PATH_INFO: `/v3/projects/b47706a33b164b94addea95a97469862/users/e00450cf0f954232bcabaac6c6d84b3c/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:39.208884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47706a33b164b94addea95a97469862, user_id=e00450cf0f954232bcabaac6c6d84b3c, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:39.211593 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:39.224816 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1451/2831] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:58:39 2022] PUT /identity/v3/projects/b47706a33b164b94addea95a97469862/users/e00450cf0f954232bcabaac6c6d84b3c/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 18:58:39.230052 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf7674-ed6d-45ed-91c5-ad250afe52c3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:39.230350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf7674-ed6d-45ed-91c5-ad250afe52c3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:39.230664 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf7674-ed6d-45ed-91c5-ad250afe52c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:39.248635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3ebf7674-ed6d-45ed-91c5-ad250afe52c3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:39.249839 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3ebf7674-ed6d-45ed-91c5-ad250afe52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:39.298577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:39.309646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1381/2832] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:39.319154 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:39.320905 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:39.380194 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d5d6-7353-4632-94c6-50dd9bbf0bf5 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:39.383910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:39.384567 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:39.384866 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:39.385149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:39.393972 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:39.395514 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:39.404887 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1452/2833] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:39.998779 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cba9c-b4cf-4691-ba1b-f2058d393b31 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:39.999338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cba9c-b4cf-4691-ba1b-f2058d393b31 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:39.999447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cba9c-b4cf-4691-ba1b-f2058d393b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:40.026435 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7b3cba9c-b4cf-4691-ba1b-f2058d393b31 None None] MFA Rules not processed for user `e00450cf0f954232bcabaac6c6d84b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:40.027718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7b3cba9c-b4cf-4691-ba1b-f2058d393b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:40.093507 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1382/2834] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:40.104667 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:40.106088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:40.134842 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:40.166020 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7fcc-efc7-4073-a2d1-0d10a8eb9ffe service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:40.169921 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:40.170577 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:40.170868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:40.171181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:40.180378 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:40.181835 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:40.191335 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1453/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:41.519920 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:41.520439 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:41.520554 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:41.537713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] MFA Rules not processed for user `e00450cf0f954232bcabaac6c6d84b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:41.538908 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:41.545994 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1383/2836] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:58:41.778079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:41.779503 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:41.791151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c1ba3-3021-4960-a03a-28ec43f6bf1b service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:41.794846 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:41.795515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:41.795800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:41.796080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:41.798267 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:41.807400 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:41.808822 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:41.817403 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1454/2837] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:42.134932 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:42.136343 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:42.207665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f7d7-c798-40f3-b69f-565e6198de66 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:42.212599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:42.213254 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:42.213544 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:42.213826 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:42.215606 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:42.227185 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:42.228770 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:42.239251 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1384/2838] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:43.860022 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:43.879458 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8eb7a2-7a8c-4f96-8e5a-5ce7cb4f17fe service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:43.883105 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:43.883748 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:43.884037 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:43.884320 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:43.886079 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:43.915046 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:43.916500 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:43.925349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1455/2839] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:44.507329 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:44.509069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:44.585766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=100 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:44.640552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80feed-1487-4a45-b0d3-afc981879b0d service placement] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:44.646443 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310e22-5621-4221-b191-4728a42c2267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:44.647131 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310e22-5621-4221-b191-4728a42c2267 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:44.647426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310e22-5621-4221-b191-4728a42c2267 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:44.647710 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310e22-5621-4221-b191-4728a42c2267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:44.649510 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c5310e22-5621-4221-b191-4728a42c2267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:44.662499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310e22-5621-4221-b191-4728a42c2267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:44.664201 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310e22-5621-4221-b191-4728a42c2267 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:44.675176 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1385/2840] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 18:58:50.059297 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:58:50.060758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:50.077810 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64e9b9-b2c0-49c3-8995-06e284b4d2c3 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:58:50.083884 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27d057-b025-4611-9b32-c2e0e51958a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:58:50.084548 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d057-b025-4611-9b32-c2e0e51958a2 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:50.084923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d057-b025-4611-9b32-c2e0e51958a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:50.085246 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d057-b025-4611-9b32-c2e0e51958a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:50.087050 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-da27d057-b025-4611-9b32-c2e0e51958a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:50.100735 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27d057-b025-4611-9b32-c2e0e51958a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:58:50.102767 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27d057-b025-4611-9b32-c2e0e51958a2 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:58:50.113562 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1456/2841] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:58:54.670528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=24 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:58:56.641871 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:58:56.642441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:58:56.642441 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:58:56.660619 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] MFA Rules not processed for user `e00450cf0f954232bcabaac6c6d84b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:58:56.661811 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:58:56.668564 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1386/2842] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:58:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:00.108863 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=46 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:06.655230 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:18.738284 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b63b1-e2b7-48e4-85cd-fd8eebe99d3f None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:18.738782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b63b1-e2b7-48e4-85cd-fd8eebe99d3f None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:18.738886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b63b1-e2b7-48e4-85cd-fd8eebe99d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:18.765935 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ca0b63b1-e2b7-48e4-85cd-fd8eebe99d3f None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:18.767157 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ca0b63b1-e2b7-48e4-85cd-fd8eebe99d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:18.822535 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1457/2843] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:59:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:18.868183 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:18.869567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:18.937565 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeab19-ba7c-4889-85ad-27bb70236b4d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:18.942483 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b29e1f-6630-45a8-9356-9f25e63e01fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:18.943175 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29e1f-6630-45a8-9356-9f25e63e01fa service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:18.943484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29e1f-6630-45a8-9356-9f25e63e01fa service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:18.943767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b29e1f-6630-45a8-9356-9f25e63e01fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:18.951671 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b29e1f-6630-45a8-9356-9f25e63e01fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:18.953247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b29e1f-6630-45a8-9356-9f25e63e01fa service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:18.961642 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1387/2844] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:59:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:59:25.020601 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b63b1-e2b7-48e4-85cd-fd8eebe99d3f None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:25.056006 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b63b1-e2b7-48e4-85cd-fd8eebe99d3f None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:25.061080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:25.062092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:25.062386 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:25.062676 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:25.065278 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:25.095599 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:25.097239 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:25.108506 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1458/2845] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:59:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:59:28.957974 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=32 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:34.291535 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc70e-5dc3-4fcb-8a92-7c0ab1c7f231 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:34.292069 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc70e-5dc3-4fcb-8a92-7c0ab1c7f231 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:34.292171 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc70e-5dc3-4fcb-8a92-7c0ab1c7f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:34.310363 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-9f7dc70e-5dc3-4fcb-8a92-7c0ab1c7f231 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:34.311599 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-9f7dc70e-5dc3-4fcb-8a92-7c0ab1c7f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:34.318855 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1388/2846] 10.222.0.43 () {58 vars in 967 bytes} [Mon Jun 20 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:34.331408 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:34.342537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b61ae-4cab-4869-b82f-3d3147c51e0b service placement] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:34.347824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:34.348502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:34.348919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:34.349206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:34.357752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:34.359391 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:34.368682 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1459/2847] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:59:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:59:36.273901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dc70e-5dc3-4fcb-8a92-7c0ab1c7f231 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:36.285563 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dc70e-5dc3-4fcb-8a92-7c0ab1c7f231 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:36.290309 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:36.291339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:36.291630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:36.291911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] PATH_INFO: `/v3/users/e00450cf0f954232bcabaac6c6d84b3c` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:36.293174 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00450cf0f954232bcabaac6c6d84b3c)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:36.296635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:36.341652 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00450cf0f954232bcabaac6c6d84b3c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.348579 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00450cf0f954232bcabaac6c6d84b3c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.355668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00450cf0f954232bcabaac6c6d84b3c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.356333 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00450cf0f954232bcabaac6c6d84b3c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.356944 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-d8447ff4-fbe6-4713-a2bf-882d9d3fa568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00450cf0f954232bcabaac6c6d84b3c'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.375188 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1389/2848] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:59:36 2022] DELETE /identity/v3/users/e00450cf0f954232bcabaac6c6d84b3c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:59:36.543734 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:36.555433 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d954ecf-7830-4369-85a7-77e6d28e7112 service swift] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:36.612913 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:36.613800 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:36.614092 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:36.614373 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] PATH_INFO: `/v3/projects/b47706a33b164b94addea95a97469862` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:36.615576 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47706a33b164b94addea95a97469862)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:36.618093 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:36.663805 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47706a33b164b94addea95a97469862', 'request_id': 'req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.666259 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:36.671515 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47706a33b164b94addea95a97469862', 'request_id': 'req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.677536 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47706a33b164b94addea95a97469862', 'request_id': 'req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.688256 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] The token cache is being invalidate because project b47706a33b164b94addea95a97469862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:59:36.688547 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.689172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-e8549d09-e3ab-4d68-b0e7-7ef3fdcb305c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:36.690702 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1460/2849] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:59:36 2022] DELETE /identity/v3/projects/b47706a33b164b94addea95a97469862 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:59:36.695625 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ccdf5-afe1-4aa9-8e13-b7032019a8b3 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:36.695904 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ccdf5-afe1-4aa9-8e13-b7032019a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:36.696189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ccdf5-afe1-4aa9-8e13-b7032019a8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:36.714414 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-396ccdf5-afe1-4aa9-8e13-b7032019a8b3 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:36.715643 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-396ccdf5-afe1-4aa9-8e13-b7032019a8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:36.772987 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1390/2850] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:36.780655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fe1e-22a1-4bbb-8e6f-1b2e1ea07c20 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:36.780953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fe1e-22a1-4bbb-8e6f-1b2e1ea07c20 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:36.781248 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fe1e-22a1-4bbb-8e6f-1b2e1ea07c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:36.800161 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-eb79fe1e-22a1-4bbb-8e6f-1b2e1ea07c20 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:36.801363 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-eb79fe1e-22a1-4bbb-8e6f-1b2e1ea07c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:36.809250 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1461/2851] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:36.813304 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ccdf5-afe1-4aa9-8e13-b7032019a8b3 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:36.822993 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ccdf5-afe1-4aa9-8e13-b7032019a8b3 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:36.827490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:36.828177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:36.828469 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:36.828748 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:36.829475 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:59:36.829782 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:36.831392 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:36.843117 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1391/2852] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:59:36.847423 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fe1e-22a1-4bbb-8e6f-1b2e1ea07c20 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:36.857122 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fe1e-22a1-4bbb-8e6f-1b2e1ea07c20 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:36.861745 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:36.862398 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:36.862687 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:36.863004 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] PATH_INFO: `/v3/projects` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:36.863694 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:36.865618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:36.889984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1462/2853] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:59:36 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:59:36.893951 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:36.904247 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ad541-70ef-4feb-a36b-557716bf96f0 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:36.950576 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:36.961206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:36.961880 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:36.962172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:36.962499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] PATH_INFO: `/v3/users` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:36.963261 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:36.965168 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:36.985021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1392/2854] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:59:36 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 18:59:36.989151 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:36.999272 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c3b1-43a9-41b4-b066-0e765623010f admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:37.003832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:37.004494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:37.004786 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:37.005070 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:37.005812 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:37.008049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:37.019311 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1463/2855] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:59:37.023193 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:37.033173 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ce5ea-76f6-4fb7-9cd5-07a7b263470c admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:37.037722 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ec21b-692b-4155-aa10-a8917f6be1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:37.038922 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ec21b-692b-4155-aa10-a8917f6be1ab admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:37.039229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ec21b-692b-4155-aa10-a8917f6be1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:37.039513 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ec21b-692b-4155-aa10-a8917f6be1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:37.040239 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ec21b-692b-4155-aa10-a8917f6be1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:37.041822 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ec21b-692b-4155-aa10-a8917f6be1ab admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:37.052551 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1393/2856] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:59:37.056428 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:37.066212 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150ab7-7118-424a-8682-2cb732a3c491 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:37.071993 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:37.072871 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:37.073155 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:37.073432 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] PATH_INFO: `/v3/projects/44115b735c764e248d69d478087654b9/users/7bc871d13de9486099640b03158fe49f/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:37.089187 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44115b735c764e248d69d478087654b9, user_id=7bc871d13de9486099640b03158fe49f, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:37.091922 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:37.104308 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1464/2857] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:59:37 2022] PUT /identity/v3/projects/44115b735c764e248d69d478087654b9/users/7bc871d13de9486099640b03158fe49f/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:59:37.164123 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c0cf-4cea-4570-8413-247b8bdc4595 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:37.164447 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c0cf-4cea-4570-8413-247b8bdc4595 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:37.164733 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c0cf-4cea-4570-8413-247b8bdc4595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:37.190615 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-2244c0cf-4cea-4570-8413-247b8bdc4595 None None] MFA Rules not processed for user `7bc871d13de9486099640b03158fe49f`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:37.191947 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-2244c0cf-4cea-4570-8413-247b8bdc4595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:37.255049 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1394/2858] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:37.266132 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:37.268478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:37.324992 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8e0c3-fdee-47f3-8b79-3ef355834a2a admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:37.328864 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2b32-eb79-44b1-b8d6-fde20aa9a52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:37.329569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2b32-eb79-44b1-b8d6-fde20aa9a52b service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:37.329857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2b32-eb79-44b1-b8d6-fde20aa9a52b service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:37.330145 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2b32-eb79-44b1-b8d6-fde20aa9a52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:37.339085 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2b32-eb79-44b1-b8d6-fde20aa9a52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:37.340524 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2b32-eb79-44b1-b8d6-fde20aa9a52b service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:37.349483 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1465/2859] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:59:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:59:38.680659 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:38.681177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:38.681280 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:38.698215 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] MFA Rules not processed for user `7bc871d13de9486099640b03158fe49f`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:38.699442 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:38.706295 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1395/2860] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:47.345241 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:DELETE=3,keystone:SELECT=59,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:48.693079 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:54.793596 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56d85-2822-4a0a-b77f-91b95d22767a None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:54.794078 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56d85-2822-4a0a-b77f-91b95d22767a None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:54.794181 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56d85-2822-4a0a-b77f-91b95d22767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:54.812740 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-b4f56d85-2822-4a0a-b77f-91b95d22767a None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:54.813919 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-b4f56d85-2822-4a0a-b77f-91b95d22767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:54.867088 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1466/2861] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:59:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:54.878595 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:54.880014 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:54.948190 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d57f88-f160-4054-8086-49a5d77b8b1d None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:54.953046 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:54.953700 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:54.953991 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:54.954278 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:54.962242 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:54.963874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:54.971742 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1396/2862] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:59:55.460097 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c836b-280f-4df1-ba8f-5caa61855be0 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:55.460394 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c836b-280f-4df1-ba8f-5caa61855be0 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:55.460677 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c836b-280f-4df1-ba8f-5caa61855be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:55.477843 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-c90c836b-280f-4df1-ba8f-5caa61855be0 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:55.479051 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c90c836b-280f-4df1-ba8f-5caa61855be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:55.485955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1467/2863] 10.222.0.43 () {58 vars in 967 bytes} [Mon Jun 20 18:59:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:55.498107 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:55.509320 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0afa52-aeb9-471d-aab2-c46dbf2ee95b service swift] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:55.514380 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:55.515060 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:55.515352 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:55.515635 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:55.523885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:55.525456 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:55.533397 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1397/2864] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:59:55.719537 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb72d6f-8af9-47d8-856a-f20956b56de6 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:55.719857 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb72d6f-8af9-47d8-856a-f20956b56de6 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:55.720120 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb72d6f-8af9-47d8-856a-f20956b56de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:55.737281 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ecb72d6f-8af9-47d8-856a-f20956b56de6 None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:55.738457 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ecb72d6f-8af9-47d8-856a-f20956b56de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:55.746277 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1468/2865] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Jun 20 18:59:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:55.758451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:55.768923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2cca9-8b7e-4b0c-be3d-fbd5e35a67a3 service swift] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:55.773979 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:55.774616 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:55.774906 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:55.775216 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:55.784297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:55.785859 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:55.794332 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1398/2866] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 18:59:56.100974 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea97fd-e9c7-423f-8217-504e9c11e8eb None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:56.101453 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea97fd-e9c7-423f-8217-504e9c11e8eb None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:56.101559 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea97fd-e9c7-423f-8217-504e9c11e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:56.118850 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f6ea97fd-e9c7-423f-8217-504e9c11e8eb None None] MFA Rules not processed for user `f9a909447947457d9b14e1369f2d8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:56.120080 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f6ea97fd-e9c7-423f-8217-504e9c11e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:56.127663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1469/2867] 10.222.0.43 () {58 vars in 967 bytes} [Mon Jun 20 18:59:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:56.139898 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:56.151355 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec00e7-06d8-466b-a21f-5f0f3d16d1de service swift] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:56.156383 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e38de-e0ba-4593-9559-355831b8118d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c42180b5adf242e489ddb24534daeea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:56.157028 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e38de-e0ba-4593-9559-355831b8118d service swift] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:56.157321 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e38de-e0ba-4593-9559-355831b8118d service swift] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:56.157607 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e38de-e0ba-4593-9559-355831b8118d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:56.165598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e38de-e0ba-4593-9559-355831b8118d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:56.167206 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e38de-e0ba-4593-9559-355831b8118d service swift] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:56.175372 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1399/2868] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Jun 20 18:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 18:59:58.178582 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea97fd-e9c7-423f-8217-504e9c11e8eb None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:58.240444 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea97fd-e9c7-423f-8217-504e9c11e8eb None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:58.244966 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:58.245848 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.246134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.246413 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] PATH_INFO: `/v3/users/7bc871d13de9486099640b03158fe49f` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.247620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc871d13de9486099640b03158fe49f)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:58.249569 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:58.294540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc871d13de9486099640b03158fe49f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.301757 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc871d13de9486099640b03158fe49f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.302417 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc871d13de9486099640b03158fe49f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.309385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc871d13de9486099640b03158fe49f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.321752 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc871d13de9486099640b03158fe49f'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.327797 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1470/2869] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 18:59:58 2022] DELETE /identity/v3/users/7bc871d13de9486099640b03158fe49f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:59:58.332273 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.332746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.332846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.350124 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:58.351847 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:58.408317 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1400/2870] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:58.418425 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:58.419886 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:58.425031 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:58.499286 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff06a7-dd14-4f02-927b-83c93c7483ab admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:58.503025 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a18d8-8cae-41e4-b39e-ee8e778cb08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:58.503688 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a18d8-8cae-41e4-b39e-ee8e778cb08c service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.503984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a18d8-8cae-41e4-b39e-ee8e778cb08c service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.504275 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a18d8-8cae-41e4-b39e-ee8e778cb08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.513397 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a18d8-8cae-41e4-b39e-ee8e778cb08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:58.514833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a18d8-8cae-41e4-b39e-ee8e778cb08c service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:58.524895 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1471/2871] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 18:59:58.691597 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:58.693057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:58.710668 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa742-cd3d-4583-906b-4a2fb4ea8244 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:58.715899 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:58.716875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.717240 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.717982 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] PATH_INFO: `/v3/projects/44115b735c764e248d69d478087654b9` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.718844 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44115b735c764e248d69d478087654b9)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:58.720911 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:58.766172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:58.769508 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44115b735c764e248d69d478087654b9', 'request_id': 'req-0251535e-54c8-4d8c-a9f5-d49d64ab9109'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.776751 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44115b735c764e248d69d478087654b9', 'request_id': 'req-0251535e-54c8-4d8c-a9f5-d49d64ab9109'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.782350 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44115b735c764e248d69d478087654b9', 'request_id': 'req-0251535e-54c8-4d8c-a9f5-d49d64ab9109'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.793627 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] The token cache is being invalidate because project 44115b735c764e248d69d478087654b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 18:59:58.793918 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.794555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-0251535e-54c8-4d8c-a9f5-d49d64ab9109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 18:59:58.796401 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1401/2872] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 18:59:58 2022] DELETE /identity/v3/projects/44115b735c764e248d69d478087654b9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:59:58.801326 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f5c84-ca8a-4b89-b13b-796b7044bb74 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.801655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f5c84-ca8a-4b89-b13b-796b7044bb74 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.801946 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f5c84-ca8a-4b89-b13b-796b7044bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.819634 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-fd6f5c84-ca8a-4b89-b13b-796b7044bb74 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:58.820824 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-fd6f5c84-ca8a-4b89-b13b-796b7044bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:58.879358 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1472/2873] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:58.887995 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730da4a2-4b7c-41d6-a051-23ac96e913d6 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.888291 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730da4a2-4b7c-41d6-a051-23ac96e913d6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.888589 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730da4a2-4b7c-41d6-a051-23ac96e913d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.906264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-730da4a2-4b7c-41d6-a051-23ac96e913d6 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:58.907490 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-730da4a2-4b7c-41d6-a051-23ac96e913d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:58.915735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1402/2874] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:58.919679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f5c84-ca8a-4b89-b13b-796b7044bb74 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:58.930186 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f5c84-ca8a-4b89-b13b-796b7044bb74 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:58.934773 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:58.935385 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.935675 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.935959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] PATH_INFO: `/v3/domains` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.936720 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 18:59:58.937032 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:58.938620 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:58.949933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1473/2875] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Jun 20 18:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 18:59:58.953941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730da4a2-4b7c-41d6-a051-23ac96e913d6 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:58.962960 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730da4a2-4b7c-41d6-a051-23ac96e913d6 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:58.967790 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:58.968476 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:58.968769 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:58.969057 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:58.969777 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:58.971746 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:58.997556 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1403/2876] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 18:59:58 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:59:59.001474 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:59.011959 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a79e6-264b-46a9-b171-006b53fba616 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:59.067339 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:59.068009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:59.068295 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:59.068574 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:59.069287 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:59.071228 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:59.090172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1474/2877] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 18:59:59 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 18:59:59.094198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:59.104921 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263c04-8694-4a66-9ec5-86b7db3c70c9 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:59.109542 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:59.110192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:59.110485 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:59.110772 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:59.111546 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:59.113238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:59.124265 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1404/2878] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 18:59:59.127875 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:59.133955 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 18:59:59.137763 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8bde6-1514-4407-94e5-1e0e6ee706d0 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:59.143345 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16fcd-3448-4198-acfa-766c5a9f262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:59.144013 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16fcd-3448-4198-acfa-766c5a9f262e admin admin] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:59.144306 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16fcd-3448-4198-acfa-766c5a9f262e admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:59.144587 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16fcd-3448-4198-acfa-766c5a9f262e admin admin] PATH_INFO: `/v3/roles` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:59.145322 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c16fcd-3448-4198-acfa-766c5a9f262e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:59.146936 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c16fcd-3448-4198-acfa-766c5a9f262e admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:59.157323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1475/2879] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 18:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 18:59:59.161246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:59.171294 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ccbc4-666c-49fe-aa28-462c14f14738 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:59.175919 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:59.176806 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:59.177097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:59.177385 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] PATH_INFO: `/v3/projects/b68045cdaa7343e0a991a76987416ded/users/70f12d37abe544eb8fa356b0f0341c08/roles/a73d3b84962843cdb2898ec86046e88e` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:59.192208 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68045cdaa7343e0a991a76987416ded, user_id=70f12d37abe544eb8fa356b0f0341c08, role_id=a73d3b84962843cdb2898ec86046e88e)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:59.195555 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:59.209297 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1405/2880] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 18:59:59 2022] PUT /identity/v3/projects/b68045cdaa7343e0a991a76987416ded/users/70f12d37abe544eb8fa356b0f0341c08/roles/a73d3b84962843cdb2898ec86046e88e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 18:59:59.214496 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da04a8-189b-4117-b0ae-d37158f39554 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:59.215009 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da04a8-189b-4117-b0ae-d37158f39554 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:59.215244 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da04a8-189b-4117-b0ae-d37158f39554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:59.233236 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-f3da04a8-189b-4117-b0ae-d37158f39554 None None] MFA Rules not processed for user `f899d83db9084c5aa9d23df884d32076`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 18:59:59.234439 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f3da04a8-189b-4117-b0ae-d37158f39554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:59.291898 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1476/2881] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 18:59:59.301468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 18:59:59.303213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 18:59:59.358788 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ce86f-61dc-43d1-bd93-bcc2d218dba2 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 18:59:59.362501 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 18:59:59.363192 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 18:59:59.363488 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 18:59:59.363775 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 18:59:59.373293 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 18:59:59.374724 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 18:59:59.384198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1406/2882] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 18:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:00:03.298876 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600889-5b7b-40d6-8f85-fcbee4bd979b None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:03.299459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600889-5b7b-40d6-8f85-fcbee4bd979b None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:03.299459 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600889-5b7b-40d6-8f85-fcbee4bd979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:03.333490 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-ad600889-5b7b-40d6-8f85-fcbee4bd979b None None] MFA Rules not processed for user `70f12d37abe544eb8fa356b0f0341c08`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 19:00:03.334832 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-ad600889-5b7b-40d6-8f85-fcbee4bd979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:00:03.402107 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1477/2883] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 19:00:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 19:00:03.406568 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:03.417703 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca410ea-caf7-471e-b00f-7c6aa944044f service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:03.422604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:03.423344 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:03.423633 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:03.423916 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:03.424605 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:03.426492 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:03.452650 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1407/2884] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Jun 20 19:00:03 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 19:00:03.456612 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600889-5b7b-40d6-8f85-fcbee4bd979b None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:03.467883 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600889-5b7b-40d6-8f85-fcbee4bd979b None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:03.544572 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:03.545177 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:03.545471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:03.545761 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:03.546717 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:03.548681 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:03.569049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1478/2885] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Jun 20 19:00:03 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 19:00:03.573198 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:03.583315 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28046b5a-7c5b-41f7-a7c7-53fcf3ef5f05 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:03.587817 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:03.588477 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:03.588763 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:03.589056 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:03.589766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:03.591399 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:03.602189 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1408/2886] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 19:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 19:00:03.606655 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:03.617333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639856c-ba80-440b-b786-6394265522e6 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:03.621930 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:03.622830 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:03.623238 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:03.623546 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] PATH_INFO: `/v3/projects/b35a0da78fbf483d894b481f3bc07466/users/f7fc4f149b574401b22efb6b573dc735/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:03.634744 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:03.639539 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35a0da78fbf483d894b481f3bc07466, user_id=f7fc4f149b574401b22efb6b573dc735, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:03.642726 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:03.656304 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1479/2887] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 19:00:03 2022] PUT /identity/v3/projects/b35a0da78fbf483d894b481f3bc07466/users/f7fc4f149b574401b22efb6b573dc735/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 19:00:03.660141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:03.670526 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8e2f-5c9f-476b-8c28-fd8823b3e92e admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:03.708223 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:03.730307 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76310a57-f27f-4895-9014-408265174f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:03.731583 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76310a57-f27f-4895-9014-408265174f74 admin admin] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:03.731875 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76310a57-f27f-4895-9014-408265174f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:03.732598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76310a57-f27f-4895-9014-408265174f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:03.733538 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76310a57-f27f-4895-9014-408265174f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:03.735177 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76310a57-f27f-4895-9014-408265174f74 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:03.746087 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1409/2888] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Jun 20 19:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 19:00:03.752527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:03.766123 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a1be-4aee-41d3-9305-65d4cb0ad7ce admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:03.770937 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:03.771867 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] REQUEST_METHOD: `PUT` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:03.772159 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:03.773023 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] PATH_INFO: `/v3/projects/b35a0da78fbf483d894b481f3bc07466/users/f7fc4f149b574401b22efb6b573dc735/roles/9e750b1ee7f949dfa2095cc5f825af30` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:03.775049 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35a0da78fbf483d894b481f3bc07466, user_id=f7fc4f149b574401b22efb6b573dc735, role_id=9e750b1ee7f949dfa2095cc5f825af30)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:03.777686 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:03.789258 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1480/2889] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Jun 20 19:00:03 2022] PUT /identity/v3/projects/b35a0da78fbf483d894b481f3bc07466/users/f7fc4f149b574401b22efb6b573dc735/roles/9e750b1ee7f949dfa2095cc5f825af30 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 19:00:08.014755 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83121c-5a68-4a63-b137-a6837ec852d2 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:08.015246 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83121c-5a68-4a63-b137-a6837ec852d2 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:08.015766 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83121c-5a68-4a63-b137-a6837ec852d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:08.052367 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-3a83121c-5a68-4a63-b137-a6837ec852d2 None None] MFA Rules not processed for user `f7fc4f149b574401b22efb6b573dc735`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 19:00:08.054235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-3a83121c-5a68-4a63-b137-a6837ec852d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:00:08.152499 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1410/2890] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 19:00:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 19:00:08.168948 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:08.171603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:00:08.292657 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7ce6a-4bb6-4c47-88a4-795b01cd7348 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:08.299741 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:08.300508 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:08.300890 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:08.301532 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:08.377530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:08.379071 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:08.389222 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1481/2891] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:00:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:00:18.144946 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=45 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:18.384923 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:28.888151 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:28.888651 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:28.888768 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:28.905816 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] MFA Rules not processed for user `70f12d37abe544eb8fa356b0f0341c08`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 19:00:28.907061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:00:28.914388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1411/2892] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 19:00:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 19:00:38.900678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=3 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:44.958082 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:44.959553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:00:45.015273 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52f0fc-127c-42d7-8ae3-5c0bd8e31073 service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:45.018792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:45.019462 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:45.019749 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:45.020033 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:45.028933 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:45.030362 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:45.039705 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1482/2893] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:00:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:00:46.806649 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:00:46.808075 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:00:46.852610 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e456e-5453-4887-bc9a-f9544e200e84 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:00:46.858549 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:00:46.859235 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:00:46.859528 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:00:46.859809 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:00:46.861577 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:00:46.874182 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:00:46.875796 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:00:46.887032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1412/2894] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:00:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:00:55.035485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=26 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:00:56.882349 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=18 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:00.752036 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:03:00.760833 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5245f-deb2-4950-9460-00b25b6afa29 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:03:00.764547 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ecd5f-414f-4e9c-bfa2-2a54c6336825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:03:00.765198 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecd5f-414f-4e9c-bfa2-2a54c6336825 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:03:00.765489 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecd5f-414f-4e9c-bfa2-2a54c6336825 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:03:00.765775 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecd5f-414f-4e9c-bfa2-2a54c6336825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:03:00.767618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-1d9ecd5f-414f-4e9c-bfa2-2a54c6336825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:03:00.781679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ecd5f-414f-4e9c-bfa2-2a54c6336825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:03:00.783178 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ecd5f-414f-4e9c-bfa2-2a54c6336825 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:03:00.795371 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1483/2895] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:03:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:03:01.970853 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:03:01.980119 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffeddc-73aa-4b51-ab43-97872d95c55c service nova] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:03:01.983717 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:03:01.984366 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:03:01.984655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:03:01.984940 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:03:01.986718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:03:02.000339 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:03:02.001762 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:03:02.013229 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1413/2896] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:03:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:03:04.323910 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee5c4-61f4-481e-840d-cab8a69f76c5 None None] REQUEST_METHOD: `POST` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:03:04.324376 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee5c4-61f4-481e-840d-cab8a69f76c5 None None] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:03:04.324485 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee5c4-61f4-481e-840d-cab8a69f76c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:03:04.341460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.auth.core [None req-13eee5c4-61f4-481e-840d-cab8a69f76c5 None None] MFA Rules not processed for user `70f12d37abe544eb8fa356b0f0341c08`. Rule list: `[]` (Enabled: `True`). {{(pid=86913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 19:03:04.342817 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-13eee5c4-61f4-481e-840d-cab8a69f76c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:03:04.350440 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1484/2897] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 19:03:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 19:03:04.658504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:03:04.666941 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1939dfd-7fbf-405c-a82c-35f212898cc0 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:03:04.670460 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:03:04.671130 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:03:04.671419 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:03:04.671699 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:03:04.673421 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:03:04.683603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:03:04.685016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:03:04.693767 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1414/2898] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:03:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:03:14.337172 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=9 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:03:14.689347 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=12 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:04:18.714352 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee5c4-61f4-481e-840d-cab8a69f76c5 None None] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:04:18.723984 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee5c4-61f4-481e-840d-cab8a69f76c5 None None] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:04:18.727471 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:04:18.728125 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:04:18.728407 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:04:18.728685 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:04:18.730460 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:04:18.740225 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:04:18.741649 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:04:18.749527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1485/2899] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:04:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:04:28.745965 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=6 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:04:30.000741 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:04:30.002172 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:04:30.068739 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a40131-2ac5-421f-8c0b-d2461b090b30 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:04:30.073665 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94427a48-63e2-428b-b977-dd52f62710d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:04:30.074312 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94427a48-63e2-428b-b977-dd52f62710d0 service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:04:30.074598 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94427a48-63e2-428b-b977-dd52f62710d0 service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:04:30.074879 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94427a48-63e2-428b-b977-dd52f62710d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:04:30.076622 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-94427a48-63e2-428b-b977-dd52f62710d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:04:30.088209 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94427a48-63e2-428b-b977-dd52f62710d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:04:30.089764 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94427a48-63e2-428b-b977-dd52f62710d0 service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:04:30.100098 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1415/2900] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:04:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:04:40.095328 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=32 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:15.195900 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:05:15.197324 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:05:15.275772 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555c624-a9e4-4533-844b-c2ec925a15f5 service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:05:15.279349 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d62786b3a2b40a6aea979d7875d410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:05:15.280002 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:05:15.280294 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:05:15.280578 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:05:15.288917 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:05:15.290389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:05:15.299183 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1486/2901] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:05:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:05:25.205620 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd10a2-cf4a-4533-96ad-ac7ea89070a6 None None] REQUEST_METHOD: `POST` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:05:25.206129 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd10a2-cf4a-4533-96ad-ac7ea89070a6 None None] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:05:25.206241 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd10a2-cf4a-4533-96ad-ac7ea89070a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:05:25.223884 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.auth.core [None req-8bbd10a2-cf4a-4533-96ad-ac7ea89070a6 None None] MFA Rules not processed for user `70f12d37abe544eb8fa356b0f0341c08`. Rule list: `[]` (Enabled: `True`). {{(pid=86914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 19:05:25.225114 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-8bbd10a2-cf4a-4533-96ad-ac7ea89070a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:05:25.232144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1416/2902] 10.222.0.43 () {58 vars in 957 bytes} [Mon Jun 20 19:05:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 19:05:25.295184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=35 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:26.970411 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:05:26.971778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:05:26.987003 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9665e-e338-4a9d-8750-32045fde4214 service cinder] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:05:26.991968 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:05:26.992624 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:05:26.992914 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:05:26.993196 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:05:26.994939 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:05:27.005918 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:05:27.007531 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:05:27.017410 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1487/2903] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:05:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:05:32.926539 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd10a2-cf4a-4533-96ad-ac7ea89070a6 None None] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:05:32.942885 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd10a2-cf4a-4533-96ad-ac7ea89070a6 None None] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:05:32.948484 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:05:32.949144 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:05:32.949430 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:05:32.949846 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:05:32.952604 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:05:32.966883 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:05:32.968876 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:05:32.982426 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1417/2904] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:05:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:05:37.013117 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=6 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:42.976673 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=9 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:05:45.937501 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:05:45.950364 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c503c8f-8d0a-41fc-b495-61fe9f1b2ee2 service placement] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:05:45.955679 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:05:45.956379 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:05:45.956669 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:05:45.956953 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:05:45.958697 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:05:45.971042 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:05:45.972595 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:05:45.983083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1488/2905] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:05:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:05:49.142101 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:05:49.151468 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4589-dc2f-4122-9ebc-cff73485e9d2 service nova] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:05:49.155264 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:05:49.155923 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:05:49.156217 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:05:49.156504 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:05:49.166007 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:05:49.167474 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:05:49.177591 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1418/2906] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:05:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:05:50.954083 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:05:50.966039 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa6b33-18ce-48b3-8b79-689007b55727 service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:05:50.971389 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a7fb173c0e439290808a6f9e1616f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:05:50.972035 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:05:50.972323 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:05:50.972603 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:05:50.981820 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:05:50.983424 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:05:50.994607 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1489/2907] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:05:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:05:59.172690 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=6 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:06:00.989881 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=12 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:08:02.309446 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:02.318630 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4454-0db4-4382-a70a-1da3bce44b47 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:02.322374 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:02.323299 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:02.323594 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:02.323877 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:02.335874 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:02.337706 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:02.350286 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1419/2908] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:08:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:08:03.542353 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:03.552618 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113ab3-8361-4564-b7ce-dbb3244921aa service nova] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:03.556478 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:03.557129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:03.557420 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:03.557706 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:03.568149 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:03.569700 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:03.580663 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1490/2909] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:08:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:08:07.678097 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:07.687270 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a15960-7462-42db-a486-4f5fcb1f1f96 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:07.692388 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d7fbf23c584c32a518abd0b5326229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:07.693032 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:07.693326 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:07.693614 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:07.763213 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:07.764655 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:07.783141 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1420/2910] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:08:10.794492 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:10.806808 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28b21c-239b-40e7-a94a-7f16f489622a service neutron] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:10.812431 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:10.813102 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:10.813392 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:10.813674 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:10.815519 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:08:10.830893 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:10.832826 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:10.852145 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1491/2911] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:08:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:08:13.638431 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:13.653646 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6add-0797-4e85-ba84-d2d6b920ded9 service neutron] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:13.658990 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:13.660567 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] REQUEST_METHOD: `GET` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:13.660856 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:13.661138 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:13.663099 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:08:13.686342 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:13.688575 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:13.703718 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1421/2912] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:08:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:08:13.712529 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:13.724310 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272eac-55f4-42de-9014-1380201e576a service placement] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:13.730333 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:13.731754 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:13.732001 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:13.732549 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] PATH_INFO: `/v3/users/70f12d37abe544eb8fa356b0f0341c08` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:13.734451 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f12d37abe544eb8fa356b0f0341c08)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:13.737828 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:13.786701 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f12d37abe544eb8fa356b0f0341c08'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:13.794073 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f12d37abe544eb8fa356b0f0341c08'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:13.794725 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f12d37abe544eb8fa356b0f0341c08'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:13.802493 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f12d37abe544eb8fa356b0f0341c08'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:13.814604 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f12d37abe544eb8fa356b0f0341c08'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:13.820502 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1492/2913] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 19:08:13 2022] DELETE /identity/v3/users/70f12d37abe544eb8fa356b0f0341c08 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 19:08:14.000686 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:14.013698 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db580-ce23-4a2b-a0f9-4309f26728f3 service placement] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:14.079824 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:14.081524 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:14.081735 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:14.082021 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] PATH_INFO: `/v3/projects/b68045cdaa7343e0a991a76987416ded` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:14.083279 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68045cdaa7343e0a991a76987416ded)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:14.085282 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:14.129914 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68045cdaa7343e0a991a76987416ded', 'request_id': 'req-7360bc2a-17cf-4e65-8166-eef0a82b8d19'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.132360 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:08:14.137533 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68045cdaa7343e0a991a76987416ded', 'request_id': 'req-7360bc2a-17cf-4e65-8166-eef0a82b8d19'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.144895 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68045cdaa7343e0a991a76987416ded', 'request_id': 'req-7360bc2a-17cf-4e65-8166-eef0a82b8d19'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.168048 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] The token cache is being invalidate because project b68045cdaa7343e0a991a76987416ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 19:08:14.168338 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.168962 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.170552 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1422/2914] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 19:08:13 2022] DELETE /identity/v3/projects/b68045cdaa7343e0a991a76987416ded => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 19:08:14.174449 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:14.175868 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:08:14.188872 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c83a5-aaf8-4b21-a127-75e0adb1adde admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:14.243906 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:14.244778 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:14.245067 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:14.245351 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] PATH_INFO: `/v3/users/f7fc4f149b574401b22efb6b573dc735` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:14.246530 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fc4f149b574401b22efb6b573dc735)` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:14.248470 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:14.293522 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fc4f149b574401b22efb6b573dc735'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.295184 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:08:14.301527 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fc4f149b574401b22efb6b573dc735'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.302523 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fc4f149b574401b22efb6b573dc735'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.310129 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fc4f149b574401b22efb6b573dc735'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.321758 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.notifications [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fc4f149b574401b22efb6b573dc735'} {{(pid=86913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.327650 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1493/2915] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Jun 20 19:08:14 2022] DELETE /identity/v3/users/f7fc4f149b574401b22efb6b573dc735 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 19:08:14.496472 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Authenticating user token {{(pid=86914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:08:14.498016 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.fernet_utils [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:08:14.512090 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360bc2a-17cf-4e65-8166-eef0a82b8d19 admin admin] Validating token access rules against request {{(pid=86914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:08:14.569559 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f899d83db9084c5aa9d23df884d32076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0b525758c904932afef5b70ff9bce58', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:08:14.570438 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:08:14.570750 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:08:14.571061 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] PATH_INFO: `/v3/projects/b35a0da78fbf483d894b481f3bc07466` {{(pid=86914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:08:14.572238 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35a0da78fbf483d894b481f3bc07466)` {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:08:14.574165 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] RBAC: Authorization granted {{(pid=86914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:08:14.618678 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35a0da78fbf483d894b481f3bc07466', 'request_id': 'req-b60f63c7-8a5b-4023-85c3-d412adc7e610'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.625901 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35a0da78fbf483d894b481f3bc07466', 'request_id': 'req-b60f63c7-8a5b-4023-85c3-d412adc7e610'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.632603 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35a0da78fbf483d894b481f3bc07466', 'request_id': 'req-b60f63c7-8a5b-4023-85c3-d412adc7e610'} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.645709 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] The token cache is being invalidate because project b35a0da78fbf483d894b481f3bc07466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 19:08:14.646451 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.646713 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG keystone.notifications [None req-b60f63c7-8a5b-4023-85c3-d412adc7e610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 19:08:14.648368 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: [pid: 86914|app: 0|req: 1423/2916] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Jun 20 19:08:14 2022] DELETE /identity/v3/projects/b35a0da78fbf483d894b481f3bc07466 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 19:08:24.324134 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=12 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:08:24.641409 dv-cinder-836973-6-iscsi devstack@keystone.service[86914]: DEBUG dbcounter [-] [86914] Writing DB stats keystone:DELETE=10,keystone:SELECT=62,keystone:INSERT=1 {{(pid=86914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 19:09:35.983369 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Authenticating user token {{(pid=86913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 19:09:35.984792 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:09:36.121782 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d88ea-18c9-4bd6-ae74-0d1d706fb008 admin admin] Validating token access rules against request {{(pid=86913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 19:09:36.178553 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16008220-2565-4b01-92eb-ebd6cd34843f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adb6160201d4470a90f3fddc3d6b043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070a4902142c4cef846767b6bbe1644d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 19:09:36.179233 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008220-2565-4b01-92eb-ebd6cd34843f service placement] REQUEST_METHOD: `GET` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 19:09:36.179543 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008220-2565-4b01-92eb-ebd6cd34843f service placement] SCRIPT_NAME: `/identity` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 19:09:36.179836 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008220-2565-4b01-92eb-ebd6cd34843f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 19:09:36.182494 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.fernet_utils [None req-16008220-2565-4b01-92eb-ebd6cd34843f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 19:09:36.193540 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16008220-2565-4b01-92eb-ebd6cd34843f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 19:09:36.195206 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16008220-2565-4b01-92eb-ebd6cd34843f service placement] RBAC: Authorization granted {{(pid=86913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 19:09:36.205525 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: [pid: 86913|app: 0|req: 1494/2917] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Jun 20 19:09:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 19:09:46.205766 dv-cinder-836973-6-iscsi devstack@keystone.service[86913]: DEBUG dbcounter [-] [86913] Writing DB stats keystone:SELECT=89 {{(pid=86913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}